Jul 22 17:16:59.471064 ip-10-0-139-124 systemd[1]: Starting Kubernetes Kubelet... Jul 22 17:16:59.907932 ip-10-0-139-124 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 17:16:59.907932 ip-10-0-139-124 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 17:16:59.907932 ip-10-0-139-124 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 17:16:59.907932 ip-10-0-139-124 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 17:16:59.907932 ip-10-0-139-124 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 17:16:59.907932 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.872562 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 17:16:59.907932 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877490 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 17:16:59.907932 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877503 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 17:16:59.907932 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877507 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 17:16:59.907932 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877510 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 17:16:59.907932 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877515 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 17:16:59.907932 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877518 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 17:16:59.907932 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877522 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 17:16:59.907932 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877524 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877528 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877531 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877533 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877536 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877538 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877548 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877552 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877556 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877559 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877562 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877565 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877567 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877570 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877572 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877575 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877578 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877582 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877585 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877588 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 17:17:00.023588 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877590 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 17:16:59.947749 ip-10-0-139-124 systemd[1]: Started Kubernetes Kubelet. Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877593 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877595 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877598 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877600 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877603 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877605 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877608 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877610 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877613 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877615 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877624 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877627 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877629 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877632 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877635 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877637 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877641 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877643 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877646 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 17:17:00.025126 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877648 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877651 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877655 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877657 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877660 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877663 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877665 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877668 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877671 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877673 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877676 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877678 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877681 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877683 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877685 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877688 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877691 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877693 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877698 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 17:17:00.026644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877701 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877705 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877707 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877710 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877713 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877721 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877724 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877727 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877729 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877731 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877734 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877736 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877739 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877741 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877744 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877747 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877749 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877752 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877754 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877757 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 17:17:00.028906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877776 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877779 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877782 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877785 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877788 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877791 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877794 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877796 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877799 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877801 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877804 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877806 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.877809 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878598 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878605 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878609 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878612 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878615 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878618 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878622 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 17:17:00.029688 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878625 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878628 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878631 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878634 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878637 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878639 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878642 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878645 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878649 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878653 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878656 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878658 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878661 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878664 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878666 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878669 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878672 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878675 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878677 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 17:17:00.030911 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878680 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878682 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878685 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878688 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878690 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878693 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878695 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878697 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878700 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878702 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878705 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878708 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878711 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878714 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878716 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878719 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878721 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878724 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878727 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878729 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 17:17:00.031743 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878731 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878734 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878736 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878739 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878741 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878745 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878748 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878751 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878753 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878756 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878778 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878783 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878787 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878790 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878793 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878796 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878798 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878801 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878803 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 17:17:00.032943 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878807 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878810 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878813 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878815 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878823 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878827 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878831 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878834 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878837 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878840 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878843 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878846 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878848 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878851 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878854 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878856 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878859 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878861 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878864 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 17:17:00.034969 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878866 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878869 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878872 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878874 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878877 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878879 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878882 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878884 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878887 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878889 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878891 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878894 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878896 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878899 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.878901 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879289 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879293 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879298 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879302 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 17:17:00.037895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879307 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879309 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879312 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879315 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879317 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879320 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879322 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879325 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879327 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879330 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879332 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879337 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879340 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879342 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879345 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879348 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879350 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879353 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879355 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879358 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 17:17:00.038577 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879361 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879363 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879365 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879369 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879373 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879376 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879379 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879382 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879385 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879387 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879392 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879394 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879397 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879400 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879402 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879406 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879409 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879412 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879415 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 17:17:00.039239 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879418 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879420 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879423 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879425 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879429 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879431 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879434 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879436 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879439 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879441 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879444 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879446 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879449 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879451 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879454 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879456 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879458 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879462 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879464 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879466 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879469 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 17:17:00.039862 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879471 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879474 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879478 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879481 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879484 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879487 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879490 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879493 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879495 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879498 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879500 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879503 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879505 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879508 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879510 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879514 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879516 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879519 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879521 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 17:17:00.040563 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879523 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879526 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879529 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879531 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879534 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879536 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879539 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879542 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879544 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879547 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879549 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879552 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879554 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879557 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879559 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.879563 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879635 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879646 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879652 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879657 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879662 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 17:17:00.041198 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879666 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879670 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879674 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879677 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879680 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879683 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879687 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879691 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879694 2566 flags.go:64] FLAG: --cgroup-root="" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879697 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879700 2566 flags.go:64] FLAG: --client-ca-file="" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879703 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879706 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879711 2566 flags.go:64] FLAG: --cluster-domain="" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879715 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879718 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879721 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879724 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879729 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879732 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879735 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879738 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879741 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879744 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 17:17:00.041936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879747 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879750 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879754 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879776 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879781 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879784 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879787 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879791 2566 flags.go:64] FLAG: --enable-server="true" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879794 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879799 2566 flags.go:64] FLAG: --event-burst="100" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879802 2566 flags.go:64] FLAG: --event-qps="50" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879805 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879808 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879811 2566 flags.go:64] FLAG: --eviction-hard="" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879814 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879819 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879822 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879825 2566 flags.go:64] FLAG: --eviction-soft="" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879827 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879830 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879833 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879836 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879839 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879842 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879845 2566 flags.go:64] FLAG: --feature-gates="" Jul 22 17:17:00.043114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879852 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879855 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879858 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879861 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879864 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879867 2566 flags.go:64] FLAG: --help="false" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879870 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879873 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879876 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879880 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879883 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879886 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879889 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879892 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879895 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879898 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879901 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879905 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879908 2566 flags.go:64] FLAG: --kube-reserved="" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879911 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879914 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879917 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879921 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879924 2566 flags.go:64] FLAG: --lock-file="" Jul 22 17:17:00.044073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879927 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879930 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879933 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879939 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879942 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879944 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879947 2566 flags.go:64] FLAG: --logging-format="text" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879950 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879953 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879956 2566 flags.go:64] FLAG: --manifest-url="" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879959 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879963 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879966 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879971 2566 flags.go:64] FLAG: --max-pods="110" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879974 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879977 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879979 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879983 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879986 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879989 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879992 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.879999 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880002 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880005 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 17:17:00.044958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880008 2566 flags.go:64] FLAG: --pod-cidr="" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880012 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880018 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880021 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880024 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880027 2566 flags.go:64] FLAG: --port="10250" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880031 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880034 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dddb9e1d7e7895bf" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880037 2566 flags.go:64] FLAG: --qos-reserved="" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880040 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880044 2566 flags.go:64] FLAG: --register-node="true" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880047 2566 flags.go:64] FLAG: --register-with-taints="" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880050 2566 flags.go:64] FLAG: --registry-burst="10" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880053 2566 flags.go:64] FLAG: --registry-qps="5" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880056 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880058 2566 flags.go:64] FLAG: --reserved-memory="" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880062 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880065 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880068 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880071 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880074 2566 flags.go:64] FLAG: --runonce="false" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880077 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880080 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880083 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880085 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 17:17:00.045810 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880088 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880093 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880096 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880099 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880102 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880105 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880108 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880111 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880114 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880117 2566 flags.go:64] FLAG: --system-cgroups="" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880120 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880125 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880128 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880132 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880136 2566 flags.go:64] FLAG: --tls-min-version="" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880140 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880142 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880145 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880148 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880151 2566 flags.go:64] FLAG: --v="2" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880155 2566 flags.go:64] FLAG: --version="false" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880159 2566 flags.go:64] FLAG: --vmodule="" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880163 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.880166 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 17:17:00.046711 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880277 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880281 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880285 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880288 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880291 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880294 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880296 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880299 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880302 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880306 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880309 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880312 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880315 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880317 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880320 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880323 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880326 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880328 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880332 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880334 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 17:17:00.047576 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880337 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880340 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880343 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880346 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880348 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880351 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880353 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880356 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880359 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880361 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880364 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880367 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880369 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880371 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880374 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880377 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880379 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880382 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880386 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 17:17:00.048298 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880389 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880392 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880397 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880401 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880403 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880406 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880409 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880411 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880414 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880417 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880419 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880422 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880427 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880430 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880433 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880436 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880439 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880441 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880444 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880446 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 17:17:00.049040 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880449 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880452 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880454 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880456 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880459 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880461 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880464 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880466 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880476 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880479 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880482 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880484 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880487 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880489 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880493 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880496 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880498 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880501 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880503 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 17:17:00.049755 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880506 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880508 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880511 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880513 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880516 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880520 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880524 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880529 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880532 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880535 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880538 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880542 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880544 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880547 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880549 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880552 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880554 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880557 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880559 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880562 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 17:17:00.050431 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.880565 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 17:17:00.051155 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.881117 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 17:17:00.051155 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.887824 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 17:17:00.051155 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.887839 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 17:17:00.051155 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.887859 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 17:17:00.051155 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.887865 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 17:17:00.051155 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887929 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 17:17:00.051155 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887934 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 17:17:00.051155 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887938 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 17:17:00.051155 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887942 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 17:17:00.051155 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887944 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 17:17:00.051155 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887947 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 17:17:00.051155 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887951 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 17:17:00.051155 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887953 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 17:17:00.051155 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887956 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 17:17:00.051155 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887959 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887963 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887967 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887976 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887979 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887982 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887985 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887988 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887990 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887994 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887997 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.887999 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888002 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888004 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888007 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888009 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888012 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888014 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888017 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888020 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 17:17:00.051702 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888023 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888026 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888028 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888031 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888033 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888036 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888039 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888041 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888044 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888046 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888049 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888051 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888054 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888056 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888059 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888061 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888064 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888067 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888070 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888072 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 17:17:00.052412 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888075 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888077 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888080 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888083 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888085 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888087 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888090 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888092 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888095 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888097 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888102 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888105 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888108 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888111 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888113 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888116 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888118 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888121 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888124 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888126 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 17:17:00.053122 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888129 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888132 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888134 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888137 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888140 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888142 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888145 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888147 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888150 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888153 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888156 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888158 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888160 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888164 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888168 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888171 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888173 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888176 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888179 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 17:17:00.053851 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888181 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 17:17:00.054529 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888183 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 17:17:00.054529 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888186 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 17:17:00.054529 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888190 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 17:17:00.054529 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888193 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 17:17:00.054529 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888195 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 17:17:00.054529 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888198 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 17:17:00.054529 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888202 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 17:17:00.054529 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888205 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 17:17:00.054529 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888208 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 17:17:00.054529 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888210 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 17:17:00.054529 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.888215 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 17:17:00.054529 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888338 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 17:17:00.054529 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888343 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 17:17:00.054529 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888346 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888349 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888351 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888354 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888357 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888360 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888363 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888365 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888369 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888372 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888374 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888376 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888379 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888381 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888384 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888386 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888389 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888391 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888394 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888396 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 17:17:00.055043 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888398 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888401 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888404 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888407 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888410 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888412 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888415 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888418 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888420 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888424 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888427 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888431 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888433 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888436 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888438 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888440 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888443 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888445 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888448 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 17:17:00.055757 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888450 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888453 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888455 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888458 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888461 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888463 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888466 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888476 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888480 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888483 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888486 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888488 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888491 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888493 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888496 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888500 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888506 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888509 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888512 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 17:17:00.056428 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888515 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888518 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888520 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888523 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888526 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888528 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888531 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888533 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888536 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888538 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888541 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888543 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888546 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888548 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888551 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888553 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888556 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888559 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888562 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888564 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 17:17:00.057121 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888567 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888569 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888572 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888574 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888577 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888579 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888581 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888584 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888587 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888592 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888596 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888599 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888602 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888605 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888607 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888610 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888613 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888616 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 17:17:00.057825 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:16:59.888619 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 17:17:00.058475 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.888624 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 17:17:00.058475 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.888719 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 17:17:00.058475 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.892017 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 17:17:00.058475 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.894368 2566 server.go:1019] "Starting client certificate rotation" Jul 22 17:17:00.058475 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.894467 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 17:17:00.058475 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.894509 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 17:17:00.058475 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.896542 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 17:17:00.058475 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.897688 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 17:17:00.058475 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.912961 2566 log.go:25] "Validated CRI v1 runtime API" Jul 22 17:17:00.058475 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.915361 2566 log.go:25] "Validated CRI v1 image API" Jul 22 17:17:00.058475 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.916250 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 17:17:00.058475 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.920590 2566 fs.go:135] Filesystem UUIDs: map[2d7550a2-078d-4946-9456-eadcc727c2e2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a43ba111-5859-49ad-8c20-653059b90ce8:/dev/nvme0n1p4] Jul 22 17:17:00.058924 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.920609 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 17:17:00.058924 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.923945 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.925410 2566 manager.go:216] Machine: {Timestamp:2026-07-22 17:16:59.924246389 +0000 UTC m=+0.335972010 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3111911 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29f025b85242602d48af78a31ecbb1 SystemUUID:ec29f025-b852-4260-2d48-af78a31ecbb1 BootID:f650a110-1c63-4b44-babb-20cd64e19ad0 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a9:7e:50:73:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a9:7e:50:73:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:94:45:96:35:8e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.925509 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.925591 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.926886 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.926910 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-124.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.927822 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.927832 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.927840 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.928481 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.930074 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.934301 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.934413 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.934441 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.934451 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.934467 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.934477 2566 kubelet.go:398] "Adding apiserver pod source" Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.934486 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 17:17:00.059013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.934935 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.934955 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.937047 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.939020 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.939053 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.939962 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.939981 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.939991 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.940000 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.940011 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.940018 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.940033 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.940045 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.940065 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.940074 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.940082 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.940088 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.940783 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.940792 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.944070 2566 server.go:1268] "Started kubelet" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.944142 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.948523 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.948604 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.949274 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-72lbm" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.949777 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-124.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.950641 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.950687 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:16:59.954484 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:16:59.954540 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:16:59.955649 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.957220 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-72lbm" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:16:59.961296 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-124.ec2.internal.18c4ac234bf85b24 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-124.ec2.internal,UID:ip-10-0-139-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-124.ec2.internal,},FirstTimestamp:2026-07-22 17:16:59.943959332 +0000 UTC m=+0.355684932,LastTimestamp:2026-07-22 17:16:59.943959332 +0000 UTC m=+0.355684932,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-124.ec2.internal,}" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.963193 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.963212 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:16:59.963271 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.963833 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.963840 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.963868 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.964006 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.964016 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 22 17:17:00.059693 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.964281 2566 factory.go:55] Registering systemd factory Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.964323 2566 factory.go:223] Registration of the systemd container factory successfully Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.964537 2566 factory.go:153] Registering CRI-O factory Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.964551 2566 factory.go:223] Registration of the crio container factory successfully Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.964609 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.964634 2566 factory.go:103] Registering Raw factory Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.964656 2566 manager.go:1196] Started watching for new ooms in manager Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.965144 2566 manager.go:349] Starting recovery of all containers Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.975933 2566 manager.go:354] Recovery completed Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.980125 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.982195 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientMemory" Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.982223 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.982235 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientPID" Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.982875 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.982889 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.982895 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.982911 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.983573 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientMemory" Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.983600 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.983614 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientPID" Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.985127 2566 policy_none.go:49] "None policy: Start" Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.985143 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.985159 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 17:17:00.061187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:16:59.987211 2566 policy_none.go:47] "Start" Jul 22 17:17:00.064143 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:00.064109 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jul 22 17:17:00.090766 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.090545 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 17:17:00.096748 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.096715 2566 manager.go:337] "Starting Device Plugin manager" Jul 22 17:17:00.096872 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:00.096770 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 17:17:00.096872 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.096829 2566 server.go:87] "Starting device plugin registration server" Jul 22 17:17:00.097202 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.097185 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 17:17:00.097280 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.097214 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 17:17:00.097352 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.097302 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 17:17:00.097490 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.097476 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 17:17:00.097490 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.097490 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 17:17:00.098141 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:00.098122 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 17:17:00.098227 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:00.098173 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-124.ec2.internal\" not found" Jul 22 17:17:00.099688 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:00.099665 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-124.ec2.internal\" not found" node="ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.199710 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.199677 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 17:17:00.201799 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.201228 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientMemory" Jul 22 17:17:00.201799 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.201264 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 17:17:00.201799 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.201279 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientPID" Jul 22 17:17:00.201799 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.201311 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.210440 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.210415 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.210440 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:00.210440 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-124.ec2.internal\": node \"ip-10-0-139-124.ec2.internal\" not found" Jul 22 17:17:00.228077 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.228049 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 17:17:00.229274 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.229256 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 17:17:00.229377 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.229292 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 17:17:00.229377 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.229316 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 17:17:00.229377 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:00.229349 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 17:17:00.232729 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.232705 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 17:17:00.242048 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:00.242028 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jul 22 17:17:00.331857 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.331745 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal"] Jul 22 17:17:00.331857 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.331857 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 17:17:00.332911 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.332893 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientMemory" Jul 22 17:17:00.332992 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.332924 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 17:17:00.332992 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.332936 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientPID" Jul 22 17:17:00.335163 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.335149 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 17:17:00.335299 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.335283 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.335337 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.335321 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 17:17:00.335977 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.335955 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientMemory" Jul 22 17:17:00.335977 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.335973 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientMemory" Jul 22 17:17:00.336125 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.335992 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 17:17:00.336125 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.336010 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientPID" Jul 22 17:17:00.336125 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.335993 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 17:17:00.336125 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.336102 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientPID" Jul 22 17:17:00.338223 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.338205 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.338309 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.338244 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 17:17:00.339079 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.339053 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientMemory" Jul 22 17:17:00.339178 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.339088 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 17:17:00.339178 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.339102 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientPID" Jul 22 17:17:00.342234 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:00.342211 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jul 22 17:17:00.355453 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:00.355431 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-124.ec2.internal\" not found" node="ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.359132 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:00.359116 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-124.ec2.internal\" not found" node="ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.366475 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.366455 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/99df169a8c0b97b53e2338ee76a4df8d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal\" (UID: \"99df169a8c0b97b53e2338ee76a4df8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.366560 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.366484 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99df169a8c0b97b53e2338ee76a4df8d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal\" (UID: \"99df169a8c0b97b53e2338ee76a4df8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.366560 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.366503 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cc9037de91dc537647b9816f92071cc8-config\") pod \"kube-apiserver-proxy-ip-10-0-139-124.ec2.internal\" (UID: \"cc9037de91dc537647b9816f92071cc8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.443078 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:00.443048 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jul 22 17:17:00.467710 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.467677 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/99df169a8c0b97b53e2338ee76a4df8d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal\" (UID: \"99df169a8c0b97b53e2338ee76a4df8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.467876 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.467723 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99df169a8c0b97b53e2338ee76a4df8d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal\" (UID: \"99df169a8c0b97b53e2338ee76a4df8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.467876 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.467748 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cc9037de91dc537647b9816f92071cc8-config\") pod \"kube-apiserver-proxy-ip-10-0-139-124.ec2.internal\" (UID: \"cc9037de91dc537647b9816f92071cc8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.467876 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.467821 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/99df169a8c0b97b53e2338ee76a4df8d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal\" (UID: \"99df169a8c0b97b53e2338ee76a4df8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.467979 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.467888 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cc9037de91dc537647b9816f92071cc8-config\") pod \"kube-apiserver-proxy-ip-10-0-139-124.ec2.internal\" (UID: \"cc9037de91dc537647b9816f92071cc8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.467979 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.467927 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99df169a8c0b97b53e2338ee76a4df8d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal\" (UID: \"99df169a8c0b97b53e2338ee76a4df8d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.544195 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:00.544157 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jul 22 17:17:00.647033 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:00.646948 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jul 22 17:17:00.659023 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.658990 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.662494 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.662478 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" Jul 22 17:17:00.749077 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:00.749026 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jul 22 17:17:00.855403 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:00.855371 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jul 22 17:17:00.892743 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.892709 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 17:17:00.892900 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.892866 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 17:17:00.892960 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.892921 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 17:17:00.955723 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:00.955656 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jul 22 17:17:00.964145 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.964114 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 17:12:00 +0000 UTC" deadline="2028-02-12 19:06:54.578901209 +0000 UTC" Jul 22 17:17:00.964145 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:00.964143 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13681h49m53.614761407s" Jul 22 17:17:01.056118 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:01.056084 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jul 22 17:17:01.157176 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:01.157140 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jul 22 17:17:01.181535 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.181503 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 17:17:01.263916 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.263892 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jul 22 17:17:01.269787 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:17:01.269740 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99df169a8c0b97b53e2338ee76a4df8d.slice/crio-59d0f2228c2e8fe9193abacb76e710e061b5bb7765b2e26537ad547652cfed85 WatchSource:0}: Error finding container 59d0f2228c2e8fe9193abacb76e710e061b5bb7765b2e26537ad547652cfed85: Status 404 returned error can't find the container with id 59d0f2228c2e8fe9193abacb76e710e061b5bb7765b2e26537ad547652cfed85 Jul 22 17:17:01.270707 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:17:01.270681 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9037de91dc537647b9816f92071cc8.slice/crio-9763d91afa28a52afb7d29aaca0b0f6e2c0dc31a0c45d0ff33db55317105ff45 WatchSource:0}: Error finding container 9763d91afa28a52afb7d29aaca0b0f6e2c0dc31a0c45d0ff33db55317105ff45: Status 404 returned error can't find the container with id 9763d91afa28a52afb7d29aaca0b0f6e2c0dc31a0c45d0ff33db55317105ff45 Jul 22 17:17:01.274503 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.274483 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 17:17:01.280191 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.280171 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 17:17:01.282100 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.282082 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" Jul 22 17:17:01.291931 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.291906 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 17:17:01.352006 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.351979 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 17:17:01.937303 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.937266 2566 apiserver.go:52] "Watching apiserver" Jul 22 17:17:01.944297 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.944265 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 17:17:01.944844 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.944819 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fgld8","kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm","openshift-cluster-node-tuning-operator/tuned-vclzk","openshift-image-registry/node-ca-nflq6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal","openshift-network-diagnostics/network-check-target-xccc6","openshift-network-operator/iptables-alerter-x2j49","kube-system/konnectivity-agent-tw7zl","openshift-dns/node-resolver-587tp","openshift-multus/multus-additional-cni-plugins-pvndg","openshift-multus/multus-jbb87","openshift-multus/network-metrics-daemon-frsjr","openshift-ovn-kubernetes/ovnkube-node-h5lb4"] Jul 22 17:17:01.949377 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.948294 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:01.949377 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:01.948399 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:01.952297 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.952270 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:01.952435 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:01.952359 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:01.954548 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.954524 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:01.957105 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.956986 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:01.958416 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.958392 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 17:17:01.958507 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.958474 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 17:17:01.958652 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.958633 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-72z66\"" Jul 22 17:17:01.958811 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.958792 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 17:17:01.959386 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.959363 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ptrm2\"" Jul 22 17:17:01.959804 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.959782 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nflq6" Jul 22 17:17:01.961465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.961443 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 17:17:01.961612 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.961593 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 17:17:01.961969 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.961948 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.963730 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.963711 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 17:17:01.963958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.963940 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 17:17:01.964151 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.964100 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lmph6\"" Jul 22 17:17:01.964304 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.964285 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 17:17:01.964381 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.964368 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 17:17:01.964888 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.964871 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tw7zl" Jul 22 17:17:01.965479 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.965459 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 17:17:01.965651 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.965507 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g2lhx\"" Jul 22 17:17:01.965722 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.965703 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 17:17:01.965722 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.965714 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 17:17:01.966006 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.965922 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 17:17:01.966378 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.966330 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 17:17:01.966472 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.966439 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 17:17:01.966541 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.966501 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 17:17:01.968537 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.968516 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:01.968637 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:01.968585 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:01.968713 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.968645 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 17:17:01.968871 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.968854 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 17:17:01.969026 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.968998 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9cfcg\"" Jul 22 17:17:01.972636 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.972615 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x2j49" Jul 22 17:17:01.974754 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.974728 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 17:17:01.975651 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.975616 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-587tp" Jul 22 17:17:01.976890 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.976868 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mdsqq\"" Jul 22 17:17:01.977096 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977070 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-tuned\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:01.977165 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977116 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba3cdbe0-6b16-4a25-8859-4514a964b597-tmp\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:01.977165 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977154 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79f5b8ea-b241-49ca-9b98-d0d6ea65ede7-serviceca\") pod \"node-ca-nflq6\" (UID: \"79f5b8ea-b241-49ca-9b98-d0d6ea65ede7\") " pod="openshift-image-registry/node-ca-nflq6" Jul 22 17:17:01.977268 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977183 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-device-dir\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:01.977268 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977228 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-slash\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.977268 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977256 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-run-openvswitch\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.977477 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977281 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-run-ovn-kubernetes\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.977477 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977316 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.977477 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977346 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-sysctl-d\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:01.977477 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977372 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlpd4\" (UniqueName: \"kubernetes.io/projected/ef134d10-4cbc-47f4-b9f1-c766024ce768-kube-api-access-jlpd4\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:01.977477 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977398 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-kubelet\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.977477 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977432 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-log-socket\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.977477 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977476 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq9xj\" (UniqueName: \"kubernetes.io/projected/340b976d-2ce2-4ba2-962e-37418239857a-kube-api-access-cq9xj\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.977823 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977502 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nv56\" (UniqueName: \"kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56\") pod \"network-check-target-xccc6\" (UID: \"04b8092a-803b-4ba2-be5a-db6df13a1bcc\") " pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:01.977823 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977536 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs\") pod \"network-metrics-daemon-frsjr\" (UID: \"0e3de27a-4391-4543-a2c7-1eea25076ccb\") " pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:01.977823 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977565 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-sysctl-conf\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:01.977823 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977598 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 17:17:01.977823 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977616 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-systemd-units\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.977823 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977647 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-var-lib-openvswitch\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.977823 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977675 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-cni-netd\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.977823 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977702 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32af3d99-28ae-4480-ad7d-7624cc5a7fb9-konnectivity-ca\") pod \"konnectivity-agent-tw7zl\" (UID: \"32af3d99-28ae-4480-ad7d-7624cc5a7fb9\") " pod="kube-system/konnectivity-agent-tw7zl" Jul 22 17:17:01.977823 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977729 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-registration-dir\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:01.977823 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977762 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-host\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:01.977823 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977789 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-modprobe-d\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:01.977823 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977233 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 17:17:01.977823 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.977813 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-run\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:01.978346 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978087 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-sys\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:01.978346 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978170 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-lib-modules\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:01.978346 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978241 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/340b976d-2ce2-4ba2-962e-37418239857a-ovnkube-config\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.978346 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978285 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-systemd\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:01.978346 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978326 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-var-lib-kubelet\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:01.978701 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978391 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xbbp\" (UniqueName: \"kubernetes.io/projected/79f5b8ea-b241-49ca-9b98-d0d6ea65ede7-kube-api-access-2xbbp\") pod \"node-ca-nflq6\" (UID: \"79f5b8ea-b241-49ca-9b98-d0d6ea65ede7\") " pod="openshift-image-registry/node-ca-nflq6" Jul 22 17:17:01.978701 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978419 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-socket-dir\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:01.978701 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978444 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-node-log\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.978701 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978468 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/340b976d-2ce2-4ba2-962e-37418239857a-ovn-node-metrics-cert\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.978701 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978487 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/340b976d-2ce2-4ba2-962e-37418239857a-ovnkube-script-lib\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.978701 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978506 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-run-ovn\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.978701 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978541 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/340b976d-2ce2-4ba2-962e-37418239857a-env-overrides\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.978701 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978575 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32af3d99-28ae-4480-ad7d-7624cc5a7fb9-agent-certs\") pod \"konnectivity-agent-tw7zl\" (UID: \"32af3d99-28ae-4480-ad7d-7624cc5a7fb9\") " pod="kube-system/konnectivity-agent-tw7zl" Jul 22 17:17:01.978701 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978600 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-sysconfig\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:01.978701 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978628 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 17:17:01.978701 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978629 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79f5b8ea-b241-49ca-9b98-d0d6ea65ede7-host\") pod \"node-ca-nflq6\" (UID: \"79f5b8ea-b241-49ca-9b98-d0d6ea65ede7\") " pod="openshift-image-registry/node-ca-nflq6" Jul 22 17:17:01.978701 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978651 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 17:17:01.978701 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978667 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-sys-fs\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:01.978701 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978691 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-etc-openvswitch\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.979416 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978715 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:01.979416 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978727 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p7x94\"" Jul 22 17:17:01.979416 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978739 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-kubernetes\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:01.979416 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978762 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rncw8\" (UniqueName: \"kubernetes.io/projected/ba3cdbe0-6b16-4a25-8859-4514a964b597-kube-api-access-rncw8\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:01.979416 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978787 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:01.979416 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978846 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-run-netns\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.979416 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978882 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-run-systemd\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.979416 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978917 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-cni-bin\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:01.979416 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.978978 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmlfx\" (UniqueName: \"kubernetes.io/projected/0e3de27a-4391-4543-a2c7-1eea25076ccb-kube-api-access-mmlfx\") pod \"network-metrics-daemon-frsjr\" (UID: \"0e3de27a-4391-4543-a2c7-1eea25076ccb\") " pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:01.979416 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.979041 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:01.979922 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.979676 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 17:17:01.981307 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.981280 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 17:17:01.981433 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.981414 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jbb87" Jul 22 17:17:01.981761 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.981732 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gq8md\"" Jul 22 17:17:01.981996 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.981978 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 17:17:01.982126 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.982109 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 17:17:01.982215 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.982199 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 17:17:01.982465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.982446 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 17:17:01.984465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.984437 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6qth4\"" Jul 22 17:17:01.985054 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:01.985032 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 17:17:02.003814 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.003764 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-26ncc" Jul 22 17:17:02.012374 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.012350 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-26ncc" Jul 22 17:17:02.065219 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.065185 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 17:17:02.079401 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079366 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:02.079576 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079409 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-run-netns\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.079576 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079438 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmlfx\" (UniqueName: \"kubernetes.io/projected/0e3de27a-4391-4543-a2c7-1eea25076ccb-kube-api-access-mmlfx\") pod \"network-metrics-daemon-frsjr\" (UID: \"0e3de27a-4391-4543-a2c7-1eea25076ccb\") " pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:02.079576 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079456 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba3cdbe0-6b16-4a25-8859-4514a964b597-tmp\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.079576 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079474 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-device-dir\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:02.079576 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079503 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-slash\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.079576 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079528 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-run-openvswitch\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.079576 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079552 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-run-ovn-kubernetes\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.079576 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079555 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-run-netns\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.079576 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079577 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.080037 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079609 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-slash\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.080037 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079627 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.080037 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079626 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs\") pod \"network-metrics-daemon-frsjr\" (UID: \"0e3de27a-4391-4543-a2c7-1eea25076ccb\") " pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:02.080037 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079683 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-device-dir\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:02.080037 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079672 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3-host-slash\") pod \"iptables-alerter-x2j49\" (UID: \"b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3\") " pod="openshift-network-operator/iptables-alerter-x2j49" Jul 22 17:17:02.080037 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079729 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-run-openvswitch\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.080037 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:02.079739 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:02.080037 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079783 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-run-ovn-kubernetes\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.080037 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079555 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:02.080037 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079732 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-sysctl-d\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.080037 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:02.079855 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs podName:0e3de27a-4391-4543-a2c7-1eea25076ccb nodeName:}" failed. No retries permitted until 2026-07-22 17:17:02.579791748 +0000 UTC m=+2.991517353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs") pod "network-metrics-daemon-frsjr" (UID: "0e3de27a-4391-4543-a2c7-1eea25076ccb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:02.080037 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079864 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 17:17:02.080037 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079881 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-sysctl-d\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.080037 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079885 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-log-socket\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.080037 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079911 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-log-socket\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.080037 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.079916 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3-iptables-alerter-script\") pod \"iptables-alerter-x2j49\" (UID: \"b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3\") " pod="openshift-network-operator/iptables-alerter-x2j49" Jul 22 17:17:02.080899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080054 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d2607d6-99cd-4939-b6fd-258d6cbbda24-system-cni-dir\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.080899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080081 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d2607d6-99cd-4939-b6fd-258d6cbbda24-os-release\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.080899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080111 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-cni-netd\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.080899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080144 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32af3d99-28ae-4480-ad7d-7624cc5a7fb9-konnectivity-ca\") pod \"konnectivity-agent-tw7zl\" (UID: \"32af3d99-28ae-4480-ad7d-7624cc5a7fb9\") " pod="kube-system/konnectivity-agent-tw7zl" Jul 22 17:17:02.080899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080168 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91bacea2-43c5-4d3f-b292-63732cb9c498-hosts-file\") pod \"node-resolver-587tp\" (UID: \"91bacea2-43c5-4d3f-b292-63732cb9c498\") " pod="openshift-dns/node-resolver-587tp" Jul 22 17:17:02.080899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080192 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-host\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.080899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080208 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-cni-netd\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.080899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/340b976d-2ce2-4ba2-962e-37418239857a-ovnkube-config\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.080899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080318 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-host\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.080899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080341 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0d2607d6-99cd-4939-b6fd-258d6cbbda24-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.080899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080381 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-run-k8s-cni-cncf-io\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.080899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080428 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-systemd\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.080899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080465 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-var-lib-kubelet\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.080899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080483 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-systemd\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.080899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080489 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xbbp\" (UniqueName: \"kubernetes.io/projected/79f5b8ea-b241-49ca-9b98-d0d6ea65ede7-kube-api-access-2xbbp\") pod \"node-ca-nflq6\" (UID: \"79f5b8ea-b241-49ca-9b98-d0d6ea65ede7\") " pod="openshift-image-registry/node-ca-nflq6" Jul 22 17:17:02.080899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080528 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-socket-dir\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:02.080899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080570 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-node-log\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.081763 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080600 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/340b976d-2ce2-4ba2-962e-37418239857a-ovnkube-script-lib\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.081763 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080628 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-cnibin\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.081763 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080653 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-var-lib-kubelet\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.081763 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080670 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-node-log\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.081763 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080679 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/340b976d-2ce2-4ba2-962e-37418239857a-env-overrides\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.081763 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080724 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32af3d99-28ae-4480-ad7d-7624cc5a7fb9-agent-certs\") pod \"konnectivity-agent-tw7zl\" (UID: \"32af3d99-28ae-4480-ad7d-7624cc5a7fb9\") " pod="kube-system/konnectivity-agent-tw7zl" Jul 22 17:17:02.081763 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080753 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret\") pod \"global-pull-secret-syncer-fgld8\" (UID: \"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f\") " pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:02.081763 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080794 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d2607d6-99cd-4939-b6fd-258d6cbbda24-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.081763 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080725 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-var-lib-kubelet\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.081763 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080815 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/340b976d-2ce2-4ba2-962e-37418239857a-ovnkube-config\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.081763 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080845 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-socket-dir\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:02.081763 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.080815 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32af3d99-28ae-4480-ad7d-7624cc5a7fb9-konnectivity-ca\") pod \"konnectivity-agent-tw7zl\" (UID: \"32af3d99-28ae-4480-ad7d-7624cc5a7fb9\") " pod="kube-system/konnectivity-agent-tw7zl" Jul 22 17:17:02.081763 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081007 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-multus-cni-dir\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.081763 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081042 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e548aa5c-72ec-4683-8c6e-134af82566e7-cni-binary-copy\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.081763 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081113 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-run-netns\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.081763 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081146 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e548aa5c-72ec-4683-8c6e-134af82566e7-multus-daemon-config\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.081763 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081179 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-sys-fs\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:02.082588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081206 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-etc-openvswitch\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.082588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081233 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d2607d6-99cd-4939-b6fd-258d6cbbda24-cnibin\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.082588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081240 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/340b976d-2ce2-4ba2-962e-37418239857a-env-overrides\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.082588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081260 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/340b976d-2ce2-4ba2-962e-37418239857a-ovnkube-script-lib\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.082588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081250 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-sys-fs\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:02.082588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081277 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-run-multus-certs\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.082588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081310 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-etc-openvswitch\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.082588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081311 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:02.082588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081443 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-kubernetes\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.082588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081419 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:02.082588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081482 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rncw8\" (UniqueName: \"kubernetes.io/projected/ba3cdbe0-6b16-4a25-8859-4514a964b597-kube-api-access-rncw8\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.082588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081506 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-kubernetes\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.082588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081555 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-run-systemd\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.082588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081583 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-cni-bin\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.082588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081626 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-run-systemd\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.082588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081663 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0d2607d6-99cd-4939-b6fd-258d6cbbda24-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.082588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081678 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-cni-bin\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.083426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081723 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-etc-kubernetes\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.083426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081750 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-tuned\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.083426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081790 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79f5b8ea-b241-49ca-9b98-d0d6ea65ede7-serviceca\") pod \"node-ca-nflq6\" (UID: \"79f5b8ea-b241-49ca-9b98-d0d6ea65ede7\") " pod="openshift-image-registry/node-ca-nflq6" Jul 22 17:17:02.083426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081818 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq9xj\" (UniqueName: \"kubernetes.io/projected/340b976d-2ce2-4ba2-962e-37418239857a-kube-api-access-cq9xj\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.083426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081854 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4sxk\" (UniqueName: \"kubernetes.io/projected/b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3-kube-api-access-x4sxk\") pod \"iptables-alerter-x2j49\" (UID: \"b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3\") " pod="openshift-network-operator/iptables-alerter-x2j49" Jul 22 17:17:02.083426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081880 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91bacea2-43c5-4d3f-b292-63732cb9c498-tmp-dir\") pod \"node-resolver-587tp\" (UID: \"91bacea2-43c5-4d3f-b292-63732cb9c498\") " pod="openshift-dns/node-resolver-587tp" Jul 22 17:17:02.083426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081902 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxdnz\" (UniqueName: \"kubernetes.io/projected/0d2607d6-99cd-4939-b6fd-258d6cbbda24-kube-api-access-qxdnz\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.083426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081924 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-multus-conf-dir\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.083426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081950 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlpd4\" (UniqueName: \"kubernetes.io/projected/ef134d10-4cbc-47f4-b9f1-c766024ce768-kube-api-access-jlpd4\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:02.083426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.081978 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-kubelet\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.083426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082001 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nv56\" (UniqueName: \"kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56\") pod \"network-check-target-xccc6\" (UID: \"04b8092a-803b-4ba2-be5a-db6df13a1bcc\") " pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:02.083426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082025 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-var-lib-cni-bin\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.083426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082059 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-hostroot\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.083426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082084 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-sysctl-conf\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.083426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082123 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-host-kubelet\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.083426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082181 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-systemd-units\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.083426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082241 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79f5b8ea-b241-49ca-9b98-d0d6ea65ede7-serviceca\") pod \"node-ca-nflq6\" (UID: \"79f5b8ea-b241-49ca-9b98-d0d6ea65ede7\") " pod="openshift-image-registry/node-ca-nflq6" Jul 22 17:17:02.084284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082307 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-sysctl-conf\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.084284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082335 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-var-lib-openvswitch\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.084284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082363 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-systemd-units\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.084284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082423 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-var-lib-openvswitch\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.084284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082441 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-var-lib-cni-multus\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.084284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082476 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-registration-dir\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:02.084284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082523 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-modprobe-d\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.084284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082540 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef134d10-4cbc-47f4-b9f1-c766024ce768-registration-dir\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:02.084284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082593 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-run\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.084284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082624 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-sys\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.084284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082632 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-modprobe-d\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.084284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082665 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-lib-modules\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.084284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082684 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-sys\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.084284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082716 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-dbus\") pod \"global-pull-secret-syncer-fgld8\" (UID: \"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f\") " pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:02.084284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082751 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d2607d6-99cd-4939-b6fd-258d6cbbda24-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.084284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082756 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-run\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.084284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082776 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-lib-modules\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.085185 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082804 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-os-release\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.085185 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082836 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/340b976d-2ce2-4ba2-962e-37418239857a-ovn-node-metrics-cert\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.085185 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082867 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-kubelet-config\") pod \"global-pull-secret-syncer-fgld8\" (UID: \"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f\") " pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:02.085185 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082893 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-multus-socket-dir-parent\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.085185 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082921 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-run-ovn\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.085185 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082945 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-system-cni-dir\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.085185 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082960 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/340b976d-2ce2-4ba2-962e-37418239857a-run-ovn\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.085185 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.082981 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56wkd\" (UniqueName: \"kubernetes.io/projected/e548aa5c-72ec-4683-8c6e-134af82566e7-kube-api-access-56wkd\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.085185 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.083008 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-sysconfig\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.085185 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.083033 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79f5b8ea-b241-49ca-9b98-d0d6ea65ede7-host\") pod \"node-ca-nflq6\" (UID: \"79f5b8ea-b241-49ca-9b98-d0d6ea65ede7\") " pod="openshift-image-registry/node-ca-nflq6" Jul 22 17:17:02.085185 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.083057 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz4bl\" (UniqueName: \"kubernetes.io/projected/91bacea2-43c5-4d3f-b292-63732cb9c498-kube-api-access-sz4bl\") pod \"node-resolver-587tp\" (UID: \"91bacea2-43c5-4d3f-b292-63732cb9c498\") " pod="openshift-dns/node-resolver-587tp" Jul 22 17:17:02.085185 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.083104 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-sysconfig\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.085185 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.083153 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79f5b8ea-b241-49ca-9b98-d0d6ea65ede7-host\") pod \"node-ca-nflq6\" (UID: \"79f5b8ea-b241-49ca-9b98-d0d6ea65ede7\") " pod="openshift-image-registry/node-ca-nflq6" Jul 22 17:17:02.085185 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.085050 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba3cdbe0-6b16-4a25-8859-4514a964b597-tmp\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.085951 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.085329 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32af3d99-28ae-4480-ad7d-7624cc5a7fb9-agent-certs\") pod \"konnectivity-agent-tw7zl\" (UID: \"32af3d99-28ae-4480-ad7d-7624cc5a7fb9\") " pod="kube-system/konnectivity-agent-tw7zl" Jul 22 17:17:02.085951 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.085620 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba3cdbe0-6b16-4a25-8859-4514a964b597-etc-tuned\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.087057 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.087029 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/340b976d-2ce2-4ba2-962e-37418239857a-ovn-node-metrics-cert\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.089094 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:02.089067 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 17:17:02.089208 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:02.089104 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 17:17:02.089208 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:02.089120 2566 projected.go:196] Error preparing data for projected volume kube-api-access-4nv56 for pod openshift-network-diagnostics/network-check-target-xccc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:02.089208 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:02.089189 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56 podName:04b8092a-803b-4ba2-be5a-db6df13a1bcc nodeName:}" failed. No retries permitted until 2026-07-22 17:17:02.58916773 +0000 UTC m=+3.000893339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4nv56" (UniqueName: "kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56") pod "network-check-target-xccc6" (UID: "04b8092a-803b-4ba2-be5a-db6df13a1bcc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:02.091872 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.091827 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rncw8\" (UniqueName: \"kubernetes.io/projected/ba3cdbe0-6b16-4a25-8859-4514a964b597-kube-api-access-rncw8\") pod \"tuned-vclzk\" (UID: \"ba3cdbe0-6b16-4a25-8859-4514a964b597\") " pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.091996 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.091915 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmlfx\" (UniqueName: \"kubernetes.io/projected/0e3de27a-4391-4543-a2c7-1eea25076ccb-kube-api-access-mmlfx\") pod \"network-metrics-daemon-frsjr\" (UID: \"0e3de27a-4391-4543-a2c7-1eea25076ccb\") " pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:02.091996 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.091965 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xbbp\" (UniqueName: \"kubernetes.io/projected/79f5b8ea-b241-49ca-9b98-d0d6ea65ede7-kube-api-access-2xbbp\") pod \"node-ca-nflq6\" (UID: \"79f5b8ea-b241-49ca-9b98-d0d6ea65ede7\") " pod="openshift-image-registry/node-ca-nflq6" Jul 22 17:17:02.092156 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.092010 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlpd4\" (UniqueName: \"kubernetes.io/projected/ef134d10-4cbc-47f4-b9f1-c766024ce768-kube-api-access-jlpd4\") pod \"aws-ebs-csi-driver-node-7nthm\" (UID: \"ef134d10-4cbc-47f4-b9f1-c766024ce768\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:02.093925 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.093869 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq9xj\" (UniqueName: \"kubernetes.io/projected/340b976d-2ce2-4ba2-962e-37418239857a-kube-api-access-cq9xj\") pod \"ovnkube-node-h5lb4\" (UID: \"340b976d-2ce2-4ba2-962e-37418239857a\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.183465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183419 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3-host-slash\") pod \"iptables-alerter-x2j49\" (UID: \"b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3\") " pod="openshift-network-operator/iptables-alerter-x2j49" Jul 22 17:17:02.183465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183471 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3-iptables-alerter-script\") pod \"iptables-alerter-x2j49\" (UID: \"b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3\") " pod="openshift-network-operator/iptables-alerter-x2j49" Jul 22 17:17:02.183735 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183525 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d2607d6-99cd-4939-b6fd-258d6cbbda24-system-cni-dir\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.183735 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183579 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d2607d6-99cd-4939-b6fd-258d6cbbda24-os-release\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.183735 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183606 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91bacea2-43c5-4d3f-b292-63732cb9c498-hosts-file\") pod \"node-resolver-587tp\" (UID: \"91bacea2-43c5-4d3f-b292-63732cb9c498\") " pod="openshift-dns/node-resolver-587tp" Jul 22 17:17:02.183735 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183619 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3-host-slash\") pod \"iptables-alerter-x2j49\" (UID: \"b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3\") " pod="openshift-network-operator/iptables-alerter-x2j49" Jul 22 17:17:02.183735 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183636 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0d2607d6-99cd-4939-b6fd-258d6cbbda24-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.183735 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183645 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d2607d6-99cd-4939-b6fd-258d6cbbda24-system-cni-dir\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.183735 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183684 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-run-k8s-cni-cncf-io\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184094 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183744 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-cnibin\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184094 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183774 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-var-lib-kubelet\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184094 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183818 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret\") pod \"global-pull-secret-syncer-fgld8\" (UID: \"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f\") " pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:02.184094 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183844 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d2607d6-99cd-4939-b6fd-258d6cbbda24-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.184094 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183870 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-multus-cni-dir\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184094 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183896 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e548aa5c-72ec-4683-8c6e-134af82566e7-cni-binary-copy\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184094 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183922 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-run-netns\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184094 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183946 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e548aa5c-72ec-4683-8c6e-134af82566e7-multus-daemon-config\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184094 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.183973 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d2607d6-99cd-4939-b6fd-258d6cbbda24-cnibin\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.184094 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184003 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-run-multus-certs\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184094 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184035 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0d2607d6-99cd-4939-b6fd-258d6cbbda24-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.184094 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184064 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-etc-kubernetes\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184094 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184075 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d2607d6-99cd-4939-b6fd-258d6cbbda24-os-release\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.184094 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184093 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4sxk\" (UniqueName: \"kubernetes.io/projected/b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3-kube-api-access-x4sxk\") pod \"iptables-alerter-x2j49\" (UID: \"b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3\") " pod="openshift-network-operator/iptables-alerter-x2j49" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184120 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91bacea2-43c5-4d3f-b292-63732cb9c498-tmp-dir\") pod \"node-resolver-587tp\" (UID: \"91bacea2-43c5-4d3f-b292-63732cb9c498\") " pod="openshift-dns/node-resolver-587tp" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184134 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3-iptables-alerter-script\") pod \"iptables-alerter-x2j49\" (UID: \"b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3\") " pod="openshift-network-operator/iptables-alerter-x2j49" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184149 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxdnz\" (UniqueName: \"kubernetes.io/projected/0d2607d6-99cd-4939-b6fd-258d6cbbda24-kube-api-access-qxdnz\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184140 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-run-k8s-cni-cncf-io\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184177 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-multus-conf-dir\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184186 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-cnibin\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184226 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-var-lib-cni-bin\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184235 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-var-lib-kubelet\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184244 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0d2607d6-99cd-4939-b6fd-258d6cbbda24-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184257 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-hostroot\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184275 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-run-netns\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184288 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-var-lib-cni-multus\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184227 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91bacea2-43c5-4d3f-b292-63732cb9c498-hosts-file\") pod \"node-resolver-587tp\" (UID: \"91bacea2-43c5-4d3f-b292-63732cb9c498\") " pod="openshift-dns/node-resolver-587tp" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184375 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-multus-conf-dir\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184392 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d2607d6-99cd-4939-b6fd-258d6cbbda24-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184440 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-dbus\") pod \"global-pull-secret-syncer-fgld8\" (UID: \"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f\") " pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184467 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d2607d6-99cd-4939-b6fd-258d6cbbda24-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.184801 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184495 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-multus-cni-dir\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184521 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-os-release\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184583 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d2607d6-99cd-4939-b6fd-258d6cbbda24-cnibin\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184606 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91bacea2-43c5-4d3f-b292-63732cb9c498-tmp-dir\") pod \"node-resolver-587tp\" (UID: \"91bacea2-43c5-4d3f-b292-63732cb9c498\") " pod="openshift-dns/node-resolver-587tp" Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184658 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-kubelet-config\") pod \"global-pull-secret-syncer-fgld8\" (UID: \"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f\") " pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184676 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-etc-kubernetes\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184688 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-multus-socket-dir-parent\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184720 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-system-cni-dir\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184749 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56wkd\" (UniqueName: \"kubernetes.io/projected/e548aa5c-72ec-4683-8c6e-134af82566e7-kube-api-access-56wkd\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184778 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz4bl\" (UniqueName: \"kubernetes.io/projected/91bacea2-43c5-4d3f-b292-63732cb9c498-kube-api-access-sz4bl\") pod \"node-resolver-587tp\" (UID: \"91bacea2-43c5-4d3f-b292-63732cb9c498\") " pod="openshift-dns/node-resolver-587tp" Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.184828 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0d2607d6-99cd-4939-b6fd-258d6cbbda24-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.185006 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-var-lib-cni-bin\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.185093 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e548aa5c-72ec-4683-8c6e-134af82566e7-multus-daemon-config\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.185114 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-dbus\") pod \"global-pull-secret-syncer-fgld8\" (UID: \"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f\") " pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.185172 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-os-release\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.185207 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-run-multus-certs\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:02.185258 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.185265 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-kubelet-config\") pod \"global-pull-secret-syncer-fgld8\" (UID: \"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f\") " pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:02.185789 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.185265 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d2607d6-99cd-4939-b6fd-258d6cbbda24-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.186711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.185282 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-system-cni-dir\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.186711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.185302 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-host-var-lib-cni-multus\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.186711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.185320 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-hostroot\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.186711 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:02.185377 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret podName:b241b6ee-11fc-44f8-b76d-2b13f6aafc5f nodeName:}" failed. No retries permitted until 2026-07-22 17:17:02.685356855 +0000 UTC m=+3.097082455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret") pod "global-pull-secret-syncer-fgld8" (UID: "b241b6ee-11fc-44f8-b76d-2b13f6aafc5f") : object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:02.186711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.185377 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e548aa5c-72ec-4683-8c6e-134af82566e7-multus-socket-dir-parent\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.186711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.185539 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e548aa5c-72ec-4683-8c6e-134af82566e7-cni-binary-copy\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.201633 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.201525 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56wkd\" (UniqueName: \"kubernetes.io/projected/e548aa5c-72ec-4683-8c6e-134af82566e7-kube-api-access-56wkd\") pod \"multus-jbb87\" (UID: \"e548aa5c-72ec-4683-8c6e-134af82566e7\") " pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.202080 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.202023 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz4bl\" (UniqueName: \"kubernetes.io/projected/91bacea2-43c5-4d3f-b292-63732cb9c498-kube-api-access-sz4bl\") pod \"node-resolver-587tp\" (UID: \"91bacea2-43c5-4d3f-b292-63732cb9c498\") " pod="openshift-dns/node-resolver-587tp" Jul 22 17:17:02.203571 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.203522 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxdnz\" (UniqueName: \"kubernetes.io/projected/0d2607d6-99cd-4939-b6fd-258d6cbbda24-kube-api-access-qxdnz\") pod \"multus-additional-cni-plugins-pvndg\" (UID: \"0d2607d6-99cd-4939-b6fd-258d6cbbda24\") " pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.204913 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.204886 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4sxk\" (UniqueName: \"kubernetes.io/projected/b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3-kube-api-access-x4sxk\") pod \"iptables-alerter-x2j49\" (UID: \"b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3\") " pod="openshift-network-operator/iptables-alerter-x2j49" Jul 22 17:17:02.234487 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.234418 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" event={"ID":"cc9037de91dc537647b9816f92071cc8","Type":"ContainerStarted","Data":"9763d91afa28a52afb7d29aaca0b0f6e2c0dc31a0c45d0ff33db55317105ff45"} Jul 22 17:17:02.235821 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.235783 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" event={"ID":"99df169a8c0b97b53e2338ee76a4df8d","Type":"ContainerStarted","Data":"59d0f2228c2e8fe9193abacb76e710e061b5bb7765b2e26537ad547652cfed85"} Jul 22 17:17:02.270384 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.270341 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" Jul 22 17:17:02.282331 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.282290 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vclzk" Jul 22 17:17:02.295613 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.295571 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nflq6" Jul 22 17:17:02.302277 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.302247 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:02.310552 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.310510 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tw7zl" Jul 22 17:17:02.317738 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.317706 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x2j49" Jul 22 17:17:02.324935 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.324908 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 17:17:02.327009 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.326981 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-587tp" Jul 22 17:17:02.337308 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.337279 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pvndg" Jul 22 17:17:02.344446 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.344423 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jbb87" Jul 22 17:17:02.588696 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.588622 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs\") pod \"network-metrics-daemon-frsjr\" (UID: \"0e3de27a-4391-4543-a2c7-1eea25076ccb\") " pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:02.588857 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:02.588791 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:02.588898 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:02.588860 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs podName:0e3de27a-4391-4543-a2c7-1eea25076ccb nodeName:}" failed. No retries permitted until 2026-07-22 17:17:03.588839599 +0000 UTC m=+4.000565188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs") pod "network-metrics-daemon-frsjr" (UID: "0e3de27a-4391-4543-a2c7-1eea25076ccb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:02.689894 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.689858 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nv56\" (UniqueName: \"kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56\") pod \"network-check-target-xccc6\" (UID: \"04b8092a-803b-4ba2-be5a-db6df13a1bcc\") " pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:02.690055 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:02.689928 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret\") pod \"global-pull-secret-syncer-fgld8\" (UID: \"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f\") " pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:02.690055 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:02.690031 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:02.690162 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:02.690049 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 17:17:02.690162 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:02.690074 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 17:17:02.690162 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:02.690085 2566 projected.go:196] Error preparing data for projected volume kube-api-access-4nv56 for pod openshift-network-diagnostics/network-check-target-xccc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:02.690162 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:02.690100 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret podName:b241b6ee-11fc-44f8-b76d-2b13f6aafc5f nodeName:}" failed. No retries permitted until 2026-07-22 17:17:03.690079014 +0000 UTC m=+4.101804620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret") pod "global-pull-secret-syncer-fgld8" (UID: "b241b6ee-11fc-44f8-b76d-2b13f6aafc5f") : object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:02.690162 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:02.690126 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56 podName:04b8092a-803b-4ba2-be5a-db6df13a1bcc nodeName:}" failed. No retries permitted until 2026-07-22 17:17:03.690114325 +0000 UTC m=+4.101839914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4nv56" (UniqueName: "kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56") pod "network-check-target-xccc6" (UID: "04b8092a-803b-4ba2-be5a-db6df13a1bcc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:03.017475 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:03.017359 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 17:12:02 +0000 UTC" deadline="2028-04-24 07:06:00.975280534 +0000 UTC" Jul 22 17:17:03.017475 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:03.017423 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15397h48m57.95786379s" Jul 22 17:17:03.230204 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:03.230163 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:03.230414 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:03.230214 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:03.230414 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:03.230311 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:03.230414 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:03.230400 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:03.230575 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:03.230439 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:03.230575 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:03.230547 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:03.342582 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:17:03.342551 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32af3d99_28ae_4480_ad7d_7624cc5a7fb9.slice/crio-df24ca9ef6eff0a7543e4df4ba8c6731c46c2d25368e4ab85c9e6d5796dab38e WatchSource:0}: Error finding container df24ca9ef6eff0a7543e4df4ba8c6731c46c2d25368e4ab85c9e6d5796dab38e: Status 404 returned error can't find the container with id df24ca9ef6eff0a7543e4df4ba8c6731c46c2d25368e4ab85c9e6d5796dab38e Jul 22 17:17:03.344246 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:17:03.344218 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode548aa5c_72ec_4683_8c6e_134af82566e7.slice/crio-91c9343e69e79cd9a2576867555f751cf783e4a9347f6e41a1b512ee575d1486 WatchSource:0}: Error finding container 91c9343e69e79cd9a2576867555f751cf783e4a9347f6e41a1b512ee575d1486: Status 404 returned error can't find the container with id 91c9343e69e79cd9a2576867555f751cf783e4a9347f6e41a1b512ee575d1486 Jul 22 17:17:03.345681 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:17:03.345650 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb78d2c3a_0dbf_43d8_8ff8_a60482ab0ed3.slice/crio-b483c609405ce5e500299d2ffa14bf43921bbd8ab1379727695d50b18411e85c WatchSource:0}: Error finding container b483c609405ce5e500299d2ffa14bf43921bbd8ab1379727695d50b18411e85c: Status 404 returned error can't find the container with id b483c609405ce5e500299d2ffa14bf43921bbd8ab1379727695d50b18411e85c Jul 22 17:17:03.347003 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:17:03.346819 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d2607d6_99cd_4939_b6fd_258d6cbbda24.slice/crio-9824767546b5de0c62e76bb8416d15351580e500e077262f8f83417fcae84cce WatchSource:0}: Error finding container 9824767546b5de0c62e76bb8416d15351580e500e077262f8f83417fcae84cce: Status 404 returned error can't find the container with id 9824767546b5de0c62e76bb8416d15351580e500e077262f8f83417fcae84cce Jul 22 17:17:03.351369 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:17:03.351332 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef134d10_4cbc_47f4_b9f1_c766024ce768.slice/crio-3d251c4174eda2f200b8d3923016577526108339f31c20e0c14acb0ed08e1b67 WatchSource:0}: Error finding container 3d251c4174eda2f200b8d3923016577526108339f31c20e0c14acb0ed08e1b67: Status 404 returned error can't find the container with id 3d251c4174eda2f200b8d3923016577526108339f31c20e0c14acb0ed08e1b67 Jul 22 17:17:03.352592 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:17:03.352569 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod340b976d_2ce2_4ba2_962e_37418239857a.slice/crio-d2d97d0093214005176b1f187a292f2aaf584f8384494ac222c4b74b23012e42 WatchSource:0}: Error finding container d2d97d0093214005176b1f187a292f2aaf584f8384494ac222c4b74b23012e42: Status 404 returned error can't find the container with id d2d97d0093214005176b1f187a292f2aaf584f8384494ac222c4b74b23012e42 Jul 22 17:17:03.354337 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:17:03.354036 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91bacea2_43c5_4d3f_b292_63732cb9c498.slice/crio-0d9d031f4db9675a14528d7bf4814781000a7be3a7c1a7ebb94851392ddd295f WatchSource:0}: Error finding container 0d9d031f4db9675a14528d7bf4814781000a7be3a7c1a7ebb94851392ddd295f: Status 404 returned error can't find the container with id 0d9d031f4db9675a14528d7bf4814781000a7be3a7c1a7ebb94851392ddd295f Jul 22 17:17:03.356150 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:17:03.355708 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f5b8ea_b241_49ca_9b98_d0d6ea65ede7.slice/crio-e7597fbe641625f31c6f388dceec99802c0528a129b01a4d3f4ac03d78b4c5ac WatchSource:0}: Error finding container e7597fbe641625f31c6f388dceec99802c0528a129b01a4d3f4ac03d78b4c5ac: Status 404 returned error can't find the container with id e7597fbe641625f31c6f388dceec99802c0528a129b01a4d3f4ac03d78b4c5ac Jul 22 17:17:03.357247 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:17:03.357017 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba3cdbe0_6b16_4a25_8859_4514a964b597.slice/crio-2a64d8a17c1a128411887b038467c0c2cf584878fa624a9b6fbe8e7bb9c9672a WatchSource:0}: Error finding container 2a64d8a17c1a128411887b038467c0c2cf584878fa624a9b6fbe8e7bb9c9672a: Status 404 returned error can't find the container with id 2a64d8a17c1a128411887b038467c0c2cf584878fa624a9b6fbe8e7bb9c9672a Jul 22 17:17:03.596422 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:03.596392 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs\") pod \"network-metrics-daemon-frsjr\" (UID: \"0e3de27a-4391-4543-a2c7-1eea25076ccb\") " pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:03.596544 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:03.596527 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:03.596604 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:03.596593 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs podName:0e3de27a-4391-4543-a2c7-1eea25076ccb nodeName:}" failed. No retries permitted until 2026-07-22 17:17:05.596576221 +0000 UTC m=+6.008301822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs") pod "network-metrics-daemon-frsjr" (UID: "0e3de27a-4391-4543-a2c7-1eea25076ccb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:03.697536 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:03.697497 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nv56\" (UniqueName: \"kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56\") pod \"network-check-target-xccc6\" (UID: \"04b8092a-803b-4ba2-be5a-db6df13a1bcc\") " pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:03.697725 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:03.697571 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret\") pod \"global-pull-secret-syncer-fgld8\" (UID: \"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f\") " pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:03.697725 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:03.697661 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:03.697725 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:03.697708 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret podName:b241b6ee-11fc-44f8-b76d-2b13f6aafc5f nodeName:}" failed. No retries permitted until 2026-07-22 17:17:05.697695083 +0000 UTC m=+6.109420672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret") pod "global-pull-secret-syncer-fgld8" (UID: "b241b6ee-11fc-44f8-b76d-2b13f6aafc5f") : object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:03.697725 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:03.697659 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 17:17:03.697980 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:03.697743 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 17:17:03.697980 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:03.697755 2566 projected.go:196] Error preparing data for projected volume kube-api-access-4nv56 for pod openshift-network-diagnostics/network-check-target-xccc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:03.697980 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:03.697778 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56 podName:04b8092a-803b-4ba2-be5a-db6df13a1bcc nodeName:}" failed. No retries permitted until 2026-07-22 17:17:05.697771711 +0000 UTC m=+6.109497313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4nv56" (UniqueName: "kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56") pod "network-check-target-xccc6" (UID: "04b8092a-803b-4ba2-be5a-db6df13a1bcc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:04.017715 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:04.017555 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 17:12:02 +0000 UTC" deadline="2028-01-08 22:59:15.671565434 +0000 UTC" Jul 22 17:17:04.017715 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:04.017621 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12845h42m11.653948877s" Jul 22 17:17:04.248265 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:04.248219 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-587tp" event={"ID":"91bacea2-43c5-4d3f-b292-63732cb9c498","Type":"ContainerStarted","Data":"0d9d031f4db9675a14528d7bf4814781000a7be3a7c1a7ebb94851392ddd295f"} Jul 22 17:17:04.252069 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:04.252039 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" event={"ID":"340b976d-2ce2-4ba2-962e-37418239857a","Type":"ContainerStarted","Data":"d2d97d0093214005176b1f187a292f2aaf584f8384494ac222c4b74b23012e42"} Jul 22 17:17:04.259454 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:04.259422 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" event={"ID":"ef134d10-4cbc-47f4-b9f1-c766024ce768","Type":"ContainerStarted","Data":"3d251c4174eda2f200b8d3923016577526108339f31c20e0c14acb0ed08e1b67"} Jul 22 17:17:04.261191 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:04.261167 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jbb87" event={"ID":"e548aa5c-72ec-4683-8c6e-134af82566e7","Type":"ContainerStarted","Data":"91c9343e69e79cd9a2576867555f751cf783e4a9347f6e41a1b512ee575d1486"} Jul 22 17:17:04.266567 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:04.266533 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvndg" event={"ID":"0d2607d6-99cd-4939-b6fd-258d6cbbda24","Type":"ContainerStarted","Data":"9824767546b5de0c62e76bb8416d15351580e500e077262f8f83417fcae84cce"} Jul 22 17:17:04.274816 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:04.274746 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x2j49" event={"ID":"b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3","Type":"ContainerStarted","Data":"b483c609405ce5e500299d2ffa14bf43921bbd8ab1379727695d50b18411e85c"} Jul 22 17:17:04.281853 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:04.281813 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" event={"ID":"cc9037de91dc537647b9816f92071cc8","Type":"ContainerStarted","Data":"d430b3ac711a2b3f713368c4e67da37a88b11fbe44421fdefd57b566f304dac8"} Jul 22 17:17:04.295766 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:04.295730 2566 generic.go:356] "Generic (PLEG): container finished" podID="99df169a8c0b97b53e2338ee76a4df8d" containerID="98891b458f73f55b91e58bfbc7665124386b05f1f7b11f4cb11fc3d73ad9defa" exitCode=0 Jul 22 17:17:04.295892 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:04.295877 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" event={"ID":"99df169a8c0b97b53e2338ee76a4df8d","Type":"ContainerDied","Data":"98891b458f73f55b91e58bfbc7665124386b05f1f7b11f4cb11fc3d73ad9defa"} Jul 22 17:17:04.301110 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:04.300779 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" podStartSLOduration=3.300760119 podStartE2EDuration="3.300760119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:04.29987427 +0000 UTC m=+4.711599908" watchObservedRunningTime="2026-07-22 17:17:04.300760119 +0000 UTC m=+4.712485736" Jul 22 17:17:04.304917 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:04.304852 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tw7zl" event={"ID":"32af3d99-28ae-4480-ad7d-7624cc5a7fb9","Type":"ContainerStarted","Data":"df24ca9ef6eff0a7543e4df4ba8c6731c46c2d25368e4ab85c9e6d5796dab38e"} Jul 22 17:17:04.319177 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:04.319014 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vclzk" event={"ID":"ba3cdbe0-6b16-4a25-8859-4514a964b597","Type":"ContainerStarted","Data":"2a64d8a17c1a128411887b038467c0c2cf584878fa624a9b6fbe8e7bb9c9672a"} Jul 22 17:17:04.337046 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:04.336958 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nflq6" event={"ID":"79f5b8ea-b241-49ca-9b98-d0d6ea65ede7","Type":"ContainerStarted","Data":"e7597fbe641625f31c6f388dceec99802c0528a129b01a4d3f4ac03d78b4c5ac"} Jul 22 17:17:05.229991 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:05.229930 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:05.230598 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:05.230113 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:05.230598 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:05.230582 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:05.230765 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:05.230738 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:05.230835 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:05.230816 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:05.230950 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:05.230929 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:05.370992 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:05.370955 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" event={"ID":"99df169a8c0b97b53e2338ee76a4df8d","Type":"ContainerStarted","Data":"e57d7fe6719f0af61b151cf2f1479d26f53f6e92299f22b878f6688d5296f2a5"} Jul 22 17:17:05.616935 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:05.616835 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs\") pod \"network-metrics-daemon-frsjr\" (UID: \"0e3de27a-4391-4543-a2c7-1eea25076ccb\") " pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:05.617132 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:05.617067 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:05.617200 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:05.617138 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs podName:0e3de27a-4391-4543-a2c7-1eea25076ccb nodeName:}" failed. No retries permitted until 2026-07-22 17:17:09.617117892 +0000 UTC m=+10.028843486 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs") pod "network-metrics-daemon-frsjr" (UID: "0e3de27a-4391-4543-a2c7-1eea25076ccb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:05.717887 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:05.717846 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret\") pod \"global-pull-secret-syncer-fgld8\" (UID: \"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f\") " pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:05.718095 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:05.717921 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nv56\" (UniqueName: \"kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56\") pod \"network-check-target-xccc6\" (UID: \"04b8092a-803b-4ba2-be5a-db6df13a1bcc\") " pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:05.718095 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:05.718059 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:05.718226 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:05.718122 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 17:17:05.718226 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:05.718145 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret podName:b241b6ee-11fc-44f8-b76d-2b13f6aafc5f nodeName:}" failed. No retries permitted until 2026-07-22 17:17:09.718124291 +0000 UTC m=+10.129849885 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret") pod "global-pull-secret-syncer-fgld8" (UID: "b241b6ee-11fc-44f8-b76d-2b13f6aafc5f") : object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:05.718226 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:05.718149 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 17:17:05.718226 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:05.718166 2566 projected.go:196] Error preparing data for projected volume kube-api-access-4nv56 for pod openshift-network-diagnostics/network-check-target-xccc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:05.718226 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:05.718222 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56 podName:04b8092a-803b-4ba2-be5a-db6df13a1bcc nodeName:}" failed. No retries permitted until 2026-07-22 17:17:09.718203719 +0000 UTC m=+10.129929327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4nv56" (UniqueName: "kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56") pod "network-check-target-xccc6" (UID: "04b8092a-803b-4ba2-be5a-db6df13a1bcc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:07.230933 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:07.230405 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:07.230933 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:07.230427 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:07.230933 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:07.230566 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:07.230933 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:07.230637 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:07.230933 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:07.230691 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:07.230933 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:07.230772 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:09.229956 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:09.229919 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:09.230408 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:09.230042 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:09.230408 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:09.230121 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:09.230408 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:09.230203 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:09.230408 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:09.230262 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:09.230408 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:09.230329 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:09.654774 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:09.654677 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs\") pod \"network-metrics-daemon-frsjr\" (UID: \"0e3de27a-4391-4543-a2c7-1eea25076ccb\") " pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:09.654937 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:09.654859 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:09.654998 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:09.654937 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs podName:0e3de27a-4391-4543-a2c7-1eea25076ccb nodeName:}" failed. No retries permitted until 2026-07-22 17:17:17.654915399 +0000 UTC m=+18.066640986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs") pod "network-metrics-daemon-frsjr" (UID: "0e3de27a-4391-4543-a2c7-1eea25076ccb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:09.755566 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:09.755526 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret\") pod \"global-pull-secret-syncer-fgld8\" (UID: \"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f\") " pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:09.755719 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:09.755588 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nv56\" (UniqueName: \"kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56\") pod \"network-check-target-xccc6\" (UID: \"04b8092a-803b-4ba2-be5a-db6df13a1bcc\") " pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:09.755719 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:09.755647 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:09.755719 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:09.755711 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret podName:b241b6ee-11fc-44f8-b76d-2b13f6aafc5f nodeName:}" failed. No retries permitted until 2026-07-22 17:17:17.755692723 +0000 UTC m=+18.167418315 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret") pod "global-pull-secret-syncer-fgld8" (UID: "b241b6ee-11fc-44f8-b76d-2b13f6aafc5f") : object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:09.756030 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:09.755718 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 17:17:09.756030 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:09.755739 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 17:17:09.756030 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:09.755753 2566 projected.go:196] Error preparing data for projected volume kube-api-access-4nv56 for pod openshift-network-diagnostics/network-check-target-xccc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:09.756030 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:09.755817 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56 podName:04b8092a-803b-4ba2-be5a-db6df13a1bcc nodeName:}" failed. No retries permitted until 2026-07-22 17:17:17.755801613 +0000 UTC m=+18.167527209 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4nv56" (UniqueName: "kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56") pod "network-check-target-xccc6" (UID: "04b8092a-803b-4ba2-be5a-db6df13a1bcc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:11.229797 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:11.229745 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:11.229797 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:11.229792 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:11.230358 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:11.229914 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:11.230358 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:11.229977 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:11.230358 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:11.229972 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:11.230358 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:11.230065 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:13.230414 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:13.230375 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:13.230868 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:13.230386 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:13.230868 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:13.230518 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:13.230868 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:13.230516 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:13.230868 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:13.230629 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:13.230868 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:13.230714 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:15.230106 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:15.230063 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:15.230564 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:15.230116 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:15.230564 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:15.230117 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:15.230564 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:15.230186 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:15.230564 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:15.230297 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:15.230564 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:15.230382 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:17.230034 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:17.229996 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:17.230539 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:17.229996 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:17.230539 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:17.230139 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:17.230539 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:17.230018 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:17.230539 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:17.230213 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:17.230539 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:17.230279 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:17.716527 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:17.716481 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs\") pod \"network-metrics-daemon-frsjr\" (UID: \"0e3de27a-4391-4543-a2c7-1eea25076ccb\") " pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:17.716707 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:17.716650 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:17.716757 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:17.716720 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs podName:0e3de27a-4391-4543-a2c7-1eea25076ccb nodeName:}" failed. No retries permitted until 2026-07-22 17:17:33.716697564 +0000 UTC m=+34.128423152 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs") pod "network-metrics-daemon-frsjr" (UID: "0e3de27a-4391-4543-a2c7-1eea25076ccb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:17.817271 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:17.817225 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nv56\" (UniqueName: \"kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56\") pod \"network-check-target-xccc6\" (UID: \"04b8092a-803b-4ba2-be5a-db6df13a1bcc\") " pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:17.817446 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:17.817318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret\") pod \"global-pull-secret-syncer-fgld8\" (UID: \"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f\") " pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:17.817446 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:17.817404 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 17:17:17.817446 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:17.817438 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 17:17:17.817587 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:17.817452 2566 projected.go:196] Error preparing data for projected volume kube-api-access-4nv56 for pod openshift-network-diagnostics/network-check-target-xccc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:17.817587 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:17.817410 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:17.817587 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:17.817510 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56 podName:04b8092a-803b-4ba2-be5a-db6df13a1bcc nodeName:}" failed. No retries permitted until 2026-07-22 17:17:33.817491169 +0000 UTC m=+34.229216768 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4nv56" (UniqueName: "kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56") pod "network-check-target-xccc6" (UID: "04b8092a-803b-4ba2-be5a-db6df13a1bcc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:17.817587 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:17.817551 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret podName:b241b6ee-11fc-44f8-b76d-2b13f6aafc5f nodeName:}" failed. No retries permitted until 2026-07-22 17:17:33.817535211 +0000 UTC m=+34.229260802 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret") pod "global-pull-secret-syncer-fgld8" (UID: "b241b6ee-11fc-44f8-b76d-2b13f6aafc5f") : object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:19.229660 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:19.229623 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:19.230165 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:19.229672 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:19.230165 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:19.229735 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:19.230165 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:19.229634 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:19.230165 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:19.229850 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:19.230165 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:19.229938 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:21.230403 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:21.230369 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:21.230876 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:21.230408 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:21.230876 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:21.230408 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:21.230876 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:21.230484 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:21.230876 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:21.230631 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:21.230876 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:21.230783 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:23.230673 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.230388 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:23.231295 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.230440 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:23.231295 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:23.230771 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:23.231295 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:23.230844 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:23.231295 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.230440 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:23.231295 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:23.230927 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:23.417856 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.417807 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tw7zl" event={"ID":"32af3d99-28ae-4480-ad7d-7624cc5a7fb9","Type":"ContainerStarted","Data":"814714d8f7665e0c50a1766da8797dd4144a2441cba1c48ca3e5180d0b9dc95c"} Jul 22 17:17:23.419518 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.419488 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vclzk" event={"ID":"ba3cdbe0-6b16-4a25-8859-4514a964b597","Type":"ContainerStarted","Data":"6838431be817a3facfe3081a7cc8823968165df3447432dfa9000f622306f8d1"} Jul 22 17:17:23.421165 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.421135 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nflq6" event={"ID":"79f5b8ea-b241-49ca-9b98-d0d6ea65ede7","Type":"ContainerStarted","Data":"7f9764dfc935dac7b8d6021bfba9dda4bf4dcb6337efeed1a63b6735a5ef6f4e"} Jul 22 17:17:23.422724 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.422702 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-587tp" event={"ID":"91bacea2-43c5-4d3f-b292-63732cb9c498","Type":"ContainerStarted","Data":"4c806b5da6bdb4a47c068859bba6c090e54d7124a9e9094a5aa288129a022783"} Jul 22 17:17:23.425896 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.425874 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" event={"ID":"340b976d-2ce2-4ba2-962e-37418239857a","Type":"ContainerStarted","Data":"63b90e49dfbd06805cd580c71ebabc9e557332b339a4b5263858d65e7500b1db"} Jul 22 17:17:23.425987 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.425944 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" event={"ID":"340b976d-2ce2-4ba2-962e-37418239857a","Type":"ContainerStarted","Data":"985b5e6c1893c54917f812882d52d9ceb01a2a9134d383827f7fd3585949b540"} Jul 22 17:17:23.426036 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.426004 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" event={"ID":"340b976d-2ce2-4ba2-962e-37418239857a","Type":"ContainerStarted","Data":"82445876dca599dbbd82541691f6976e5e000de4f2ba5773a5edf73ad6ca688c"} Jul 22 17:17:23.426084 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.426053 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" event={"ID":"340b976d-2ce2-4ba2-962e-37418239857a","Type":"ContainerStarted","Data":"c562b04bc3f1ae1e53f4b30278c65d2b2656bb7bafa6d07455fd077f07ed40a5"} Jul 22 17:17:23.426130 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.426101 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" event={"ID":"340b976d-2ce2-4ba2-962e-37418239857a","Type":"ContainerStarted","Data":"f592f60d4f091d3068f60421b70121d8b884b2e5eaa1ec5900ce0a45406eb310"} Jul 22 17:17:23.426164 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.426133 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" event={"ID":"340b976d-2ce2-4ba2-962e-37418239857a","Type":"ContainerStarted","Data":"49e93f584a0c3c64a1d74d8785850c5955d874fe19bd2717757668310a6f607a"} Jul 22 17:17:23.427384 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.427361 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" event={"ID":"ef134d10-4cbc-47f4-b9f1-c766024ce768","Type":"ContainerStarted","Data":"c20f178c72bcb0d857d1c4c2e64edff80ba39ea082c104bf8f6fad789063e328"} Jul 22 17:17:23.429089 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.429064 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jbb87" event={"ID":"e548aa5c-72ec-4683-8c6e-134af82566e7","Type":"ContainerStarted","Data":"8eb523c24dca1ce476ff69cca5274853637d99cb4bad5ef307804775cf96a1f2"} Jul 22 17:17:23.430950 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.430926 2566 generic.go:356] "Generic (PLEG): container finished" podID="0d2607d6-99cd-4939-b6fd-258d6cbbda24" containerID="76b5f9b8f7db24aa923b618215c720d1e294ac0b1bc8f1b3deb539f49b6ad0d8" exitCode=0 Jul 22 17:17:23.431037 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.430970 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvndg" event={"ID":"0d2607d6-99cd-4939-b6fd-258d6cbbda24","Type":"ContainerDied","Data":"76b5f9b8f7db24aa923b618215c720d1e294ac0b1bc8f1b3deb539f49b6ad0d8"} Jul 22 17:17:23.434305 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.434258 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" podStartSLOduration=22.434241501 podStartE2EDuration="22.434241501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:05.390629733 +0000 UTC m=+5.802355374" watchObservedRunningTime="2026-07-22 17:17:23.434241501 +0000 UTC m=+23.845967111" Jul 22 17:17:23.434520 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.434475 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tw7zl" podStartSLOduration=4.339406689 podStartE2EDuration="23.434465412s" totalImagesPullingTime="19.095058723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:23.434202167 +0000 UTC m=+23.845927800" watchObservedRunningTime="2026-07-22 17:17:23.434465412 +0000 UTC m=+23.846191022" Jul 22 17:17:23.454056 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.454002 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jbb87" podStartSLOduration=4.275385695 podStartE2EDuration="23.453988089s" totalImagesPullingTime="19.178602394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:23.453512179 +0000 UTC m=+23.865237789" watchObservedRunningTime="2026-07-22 17:17:23.453988089 +0000 UTC m=+23.865713697" Jul 22 17:17:23.468030 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.467977 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nflq6" podStartSLOduration=4.360153009 podStartE2EDuration="23.467963916s" totalImagesPullingTime="19.107810907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:23.46736886 +0000 UTC m=+23.879094472" watchObservedRunningTime="2026-07-22 17:17:23.467963916 +0000 UTC m=+23.879689525" Jul 22 17:17:23.481520 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.481461 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-587tp" podStartSLOduration=4.363705476 podStartE2EDuration="23.481442961s" totalImagesPullingTime="19.117737485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:23.480694307 +0000 UTC m=+23.892419916" watchObservedRunningTime="2026-07-22 17:17:23.481442961 +0000 UTC m=+23.893168572" Jul 22 17:17:23.522840 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.522793 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vclzk" podStartSLOduration=4.399297642 podStartE2EDuration="23.522756797s" totalImagesPullingTime="19.123459155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:23.522482356 +0000 UTC m=+23.934207965" watchObservedRunningTime="2026-07-22 17:17:23.522756797 +0000 UTC m=+23.934482406" Jul 22 17:17:23.524628 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.524605 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tw7zl" Jul 22 17:17:23.525141 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:23.525127 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tw7zl" Jul 22 17:17:24.207203 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:24.207168 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 17:17:24.434933 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:24.434900 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" event={"ID":"ef134d10-4cbc-47f4-b9f1-c766024ce768","Type":"ContainerStarted","Data":"6e00b4849f86de15ebfa5171ae8975c4d3f791d558915fa180d84fb126cb1448"} Jul 22 17:17:24.436351 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:24.436315 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x2j49" event={"ID":"b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3","Type":"ContainerStarted","Data":"5435c681717e171243717bc57cb426a8b5a5676df20d8d1f7b002ba89bf512f0"} Jul 22 17:17:24.436910 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:24.436893 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tw7zl" Jul 22 17:17:24.437032 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:24.436961 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tw7zl" Jul 22 17:17:24.450823 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:24.450780 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x2j49" podStartSLOduration=5.328737991 podStartE2EDuration="24.450751242s" totalImagesPullingTime="19.122013251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:24.450372052 +0000 UTC m=+24.862097668" watchObservedRunningTime="2026-07-22 17:17:24.450751242 +0000 UTC m=+24.862476853" Jul 22 17:17:25.111050 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:25.110950 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T17:17:24.207198573Z","UUID":"60b993d0-6cbd-42d1-9ab1-a810435bf365","Handler":null,"Name":"","Endpoint":""} Jul 22 17:17:25.112433 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:25.112405 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 17:17:25.112552 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:25.112449 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 17:17:25.230536 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:25.230500 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:25.230536 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:25.230533 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:25.230785 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:25.230539 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:25.230785 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:25.230625 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:25.230785 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:25.230682 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:25.230944 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:25.230804 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:25.445698 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:25.445473 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" event={"ID":"ef134d10-4cbc-47f4-b9f1-c766024ce768","Type":"ContainerStarted","Data":"ca04ec181756feb13d87ec41e5377d1d6fffb2bb10b3d6fd93f6b3d7de1d7412"} Jul 22 17:17:25.462945 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:25.462899 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nthm" podStartSLOduration=3.889037928 podStartE2EDuration="25.462883227s" totalImagesPullingTime="21.573845299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:25.462849231 +0000 UTC m=+25.874574863" watchObservedRunningTime="2026-07-22 17:17:25.462883227 +0000 UTC m=+25.874608835" Jul 22 17:17:26.451838 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:26.451795 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" event={"ID":"340b976d-2ce2-4ba2-962e-37418239857a","Type":"ContainerStarted","Data":"eaa34cefd16b1ec4cfc01a752f873d7d914b19c166360fce0a5f63aa2fe4bf88"} Jul 22 17:17:27.229587 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:27.229548 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:27.229744 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:27.229548 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:27.229744 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:27.229686 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:27.229744 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:27.229548 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:27.229905 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:27.229747 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:27.229905 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:27.229846 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:28.460085 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:28.459844 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" event={"ID":"340b976d-2ce2-4ba2-962e-37418239857a","Type":"ContainerStarted","Data":"adeb4ef65a11800b95ac189adfc7bbd74c0b84f6fe15fe12df9f954e8a918a1d"} Jul 22 17:17:28.460894 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:28.460168 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:28.460894 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:28.460220 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:28.461712 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:28.461688 2566 generic.go:356] "Generic (PLEG): container finished" podID="0d2607d6-99cd-4939-b6fd-258d6cbbda24" containerID="25024a0b42bdf0eab0855220b2e43b5835bbddcbc47029ddb2a1dfff0ecb4995" exitCode=0 Jul 22 17:17:28.461824 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:28.461734 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvndg" event={"ID":"0d2607d6-99cd-4939-b6fd-258d6cbbda24","Type":"ContainerDied","Data":"25024a0b42bdf0eab0855220b2e43b5835bbddcbc47029ddb2a1dfff0ecb4995"} Jul 22 17:17:28.475981 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:28.475957 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:28.485973 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:28.485930 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" podStartSLOduration=9.293000969 podStartE2EDuration="28.48591808s" totalImagesPullingTime="19.192917111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:28.48549029 +0000 UTC m=+28.897215899" watchObservedRunningTime="2026-07-22 17:17:28.48591808 +0000 UTC m=+28.897643689" Jul 22 17:17:29.230508 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:29.230470 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:29.230749 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:29.230472 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:29.230749 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:29.230585 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:29.230749 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:29.230664 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:29.230749 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:29.230472 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:29.230749 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:29.230737 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:29.465443 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:29.465401 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:29.482718 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:29.482384 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:17:29.736889 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:29.736709 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fgld8"] Jul 22 17:17:29.736986 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:29.736959 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:29.737056 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:29.737039 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:29.740479 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:29.740452 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xccc6"] Jul 22 17:17:29.740597 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:29.740555 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:29.740662 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:29.740638 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:29.743343 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:29.743311 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-frsjr"] Jul 22 17:17:29.743434 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:29.743420 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:29.743543 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:29.743521 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:30.469353 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:30.469316 2566 generic.go:356] "Generic (PLEG): container finished" podID="0d2607d6-99cd-4939-b6fd-258d6cbbda24" containerID="575b86af719c7b7d88d9cd7aa09086e239378d02686ac13cee6684e4b5cc82ad" exitCode=0 Jul 22 17:17:30.469825 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:30.469391 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvndg" event={"ID":"0d2607d6-99cd-4939-b6fd-258d6cbbda24","Type":"ContainerDied","Data":"575b86af719c7b7d88d9cd7aa09086e239378d02686ac13cee6684e4b5cc82ad"} Jul 22 17:17:30.710247 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:30.710215 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-587tp_91bacea2-43c5-4d3f-b292-63732cb9c498/dns-node-resolver/0.log" Jul 22 17:17:31.229883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:31.229839 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:31.229883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:31.229859 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:31.230116 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:31.229855 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:31.230116 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:31.229962 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:31.230116 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:31.230049 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:31.230211 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:31.230136 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:31.864107 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:31.864079 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nflq6_79f5b8ea-b241-49ca-9b98-d0d6ea65ede7/node-ca/0.log" Jul 22 17:17:32.475282 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:32.475250 2566 generic.go:356] "Generic (PLEG): container finished" podID="0d2607d6-99cd-4939-b6fd-258d6cbbda24" containerID="f793ca9591e20bab5ab5103cdd14ca1b6273454342e8e86e9a86c609d13242fb" exitCode=0 Jul 22 17:17:32.475454 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:32.475294 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvndg" event={"ID":"0d2607d6-99cd-4939-b6fd-258d6cbbda24","Type":"ContainerDied","Data":"f793ca9591e20bab5ab5103cdd14ca1b6273454342e8e86e9a86c609d13242fb"} Jul 22 17:17:33.230328 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:33.230295 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:33.230964 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:33.230340 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:33.230964 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:33.230295 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:33.230964 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:33.230510 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:33.230964 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:33.230683 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:33.230964 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:33.230882 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:33.731868 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:33.731827 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs\") pod \"network-metrics-daemon-frsjr\" (UID: \"0e3de27a-4391-4543-a2c7-1eea25076ccb\") " pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:33.732034 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:33.732015 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:33.732108 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:33.732095 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs podName:0e3de27a-4391-4543-a2c7-1eea25076ccb nodeName:}" failed. No retries permitted until 2026-07-22 17:18:05.732071253 +0000 UTC m=+66.143796855 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs") pod "network-metrics-daemon-frsjr" (UID: "0e3de27a-4391-4543-a2c7-1eea25076ccb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:33.832582 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:33.832544 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret\") pod \"global-pull-secret-syncer-fgld8\" (UID: \"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f\") " pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:33.832790 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:33.832610 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nv56\" (UniqueName: \"kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56\") pod \"network-check-target-xccc6\" (UID: \"04b8092a-803b-4ba2-be5a-db6df13a1bcc\") " pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:33.832790 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:33.832736 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:33.832918 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:33.832805 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 17:17:33.832918 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:33.832822 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret podName:b241b6ee-11fc-44f8-b76d-2b13f6aafc5f nodeName:}" failed. No retries permitted until 2026-07-22 17:18:05.832801682 +0000 UTC m=+66.244527279 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret") pod "global-pull-secret-syncer-fgld8" (UID: "b241b6ee-11fc-44f8-b76d-2b13f6aafc5f") : object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:33.832918 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:33.832826 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 17:17:33.832918 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:33.832843 2566 projected.go:196] Error preparing data for projected volume kube-api-access-4nv56 for pod openshift-network-diagnostics/network-check-target-xccc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:33.832918 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:33.832894 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56 podName:04b8092a-803b-4ba2-be5a-db6df13a1bcc nodeName:}" failed. No retries permitted until 2026-07-22 17:18:05.832878406 +0000 UTC m=+66.244603996 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4nv56" (UniqueName: "kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56") pod "network-check-target-xccc6" (UID: "04b8092a-803b-4ba2-be5a-db6df13a1bcc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:35.229548 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:35.229516 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:35.229548 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:35.229532 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:35.230064 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:35.229554 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:35.230064 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:35.229645 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:35.230064 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:35.229753 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:35.230064 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:35.229861 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:37.229836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:37.229805 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:37.229836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:37.229842 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:37.230250 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:37.229814 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:37.230250 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:37.229905 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:37.230250 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:37.229970 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:37.230250 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:37.230033 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:37.493061 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:37.492972 2566 generic.go:356] "Generic (PLEG): container finished" podID="0d2607d6-99cd-4939-b6fd-258d6cbbda24" containerID="485f82073d04a6a97cc76497fd20138d92e0ad396c18aa17dba34333ff9818c9" exitCode=0 Jul 22 17:17:37.493061 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:37.493014 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvndg" event={"ID":"0d2607d6-99cd-4939-b6fd-258d6cbbda24","Type":"ContainerDied","Data":"485f82073d04a6a97cc76497fd20138d92e0ad396c18aa17dba34333ff9818c9"} Jul 22 17:17:38.499105 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:38.498855 2566 generic.go:356] "Generic (PLEG): container finished" podID="0d2607d6-99cd-4939-b6fd-258d6cbbda24" containerID="d19e3d62aec3241447f5fd280e82052ff8d94e3fef646b6bb7d0609cdda0f6b8" exitCode=0 Jul 22 17:17:38.499481 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:38.498944 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvndg" event={"ID":"0d2607d6-99cd-4939-b6fd-258d6cbbda24","Type":"ContainerDied","Data":"d19e3d62aec3241447f5fd280e82052ff8d94e3fef646b6bb7d0609cdda0f6b8"} Jul 22 17:17:39.230357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:39.230323 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:39.230357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:39.230350 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:39.230617 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:39.230323 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:39.230617 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:39.230453 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:39.230617 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:39.230558 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:39.230800 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:39.230624 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:39.504709 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:39.504622 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvndg" event={"ID":"0d2607d6-99cd-4939-b6fd-258d6cbbda24","Type":"ContainerStarted","Data":"2df58732a9120469cdd5ffd88095f53bdb277edf870e1a39c7bfe24ce4e15266"} Jul 22 17:17:39.530613 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:39.530564 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pvndg" podStartSLOduration=9.91072117 podStartE2EDuration="39.530547051s" totalImagesPullingTime="29.619825881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:39.529933803 +0000 UTC m=+39.941659414" watchObservedRunningTime="2026-07-22 17:17:39.530547051 +0000 UTC m=+39.942272656" Jul 22 17:17:41.229745 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:41.229698 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:41.230169 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:41.229830 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:41.230169 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:41.229842 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:41.230169 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:41.229855 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:41.230169 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:41.229909 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:41.230169 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:41.230005 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:43.229939 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:43.229902 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:43.230382 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:43.229946 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:43.230382 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:43.229999 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:43.230382 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:43.230010 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:43.230382 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:43.230064 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:43.230382 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:43.230148 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:45.229562 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:45.229529 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:45.229562 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:45.229559 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:45.230116 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:45.229541 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:45.230116 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:45.229660 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:45.230116 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:45.229749 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:45.230116 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:45.229859 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:47.229702 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:47.229662 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:47.229702 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:47.229705 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:47.230221 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:47.229780 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:47.230221 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:47.229796 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:47.230221 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:47.229847 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:47.230221 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:47.229912 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:49.229775 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:49.229726 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:49.230231 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:49.229842 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:49.230231 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:49.229960 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:49.230231 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:49.229848 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:49.230231 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:49.230056 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:49.230231 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:49.229844 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:51.229781 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:51.229735 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:51.230184 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:51.229790 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:51.230184 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:51.229735 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:51.230184 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:51.229847 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:51.230184 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:51.229911 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:51.230184 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:51.229963 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:53.230364 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:53.230323 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:53.230364 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:53.230346 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:53.230854 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:53.230450 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:53.230854 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:53.230500 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:53.230854 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:53.230605 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:53.230854 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:53.230666 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:55.230355 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:55.230311 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:55.230355 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:55.230354 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:55.230832 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:55.230317 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:55.230832 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:55.230424 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:55.230832 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:55.230480 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:55.230832 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:55.230571 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:57.230264 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.230182 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:57.230622 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.230182 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:57.230622 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:57.230291 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frsjr" podUID="0e3de27a-4391-4543-a2c7-1eea25076ccb" Jul 22 17:17:57.230622 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.230182 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:57.230622 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:57.230352 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xccc6" podUID="04b8092a-803b-4ba2-be5a-db6df13a1bcc" Jul 22 17:17:57.230622 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:17:57.230419 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fgld8" podUID="b241b6ee-11fc-44f8-b76d-2b13f6aafc5f" Jul 22 17:17:57.411714 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.411687 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeReady" Jul 22 17:17:57.411924 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.411815 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 17:17:57.489363 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.488229 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g4n2l"] Jul 22 17:17:57.491728 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.490360 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g4n2l" Jul 22 17:17:57.504566 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.504522 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hdsp4"] Jul 22 17:17:57.504825 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.504796 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 17:17:57.504924 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.504900 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 17:17:57.504924 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.504781 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5ptkt\"" Jul 22 17:17:57.506772 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.506738 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hdsp4" Jul 22 17:17:57.521960 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.521933 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 17:17:57.522101 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.522001 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 17:17:57.522202 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.522176 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 17:17:57.522394 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.522382 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 17:17:57.522432 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.522386 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jgstf\"" Jul 22 17:17:57.526450 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.526431 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g4n2l"] Jul 22 17:17:57.547429 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.547400 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hdsp4"] Jul 22 17:17:57.548106 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.548081 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hq6br"] Jul 22 17:17:57.549906 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.549887 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hq6br" Jul 22 17:17:57.553619 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.553601 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 17:17:57.553721 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.553609 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 17:17:57.553721 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.553677 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 17:17:57.553721 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.553704 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qg6w7\"" Jul 22 17:17:57.569579 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.569552 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hq6br"] Jul 22 17:17:57.602944 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.602914 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8895870b-2261-4c6f-9dea-1adb67052122-metrics-tls\") pod \"dns-default-g4n2l\" (UID: \"8895870b-2261-4c6f-9dea-1adb67052122\") " pod="openshift-dns/dns-default-g4n2l" Jul 22 17:17:57.602944 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.602954 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8895870b-2261-4c6f-9dea-1adb67052122-tmp-dir\") pod \"dns-default-g4n2l\" (UID: \"8895870b-2261-4c6f-9dea-1adb67052122\") " pod="openshift-dns/dns-default-g4n2l" Jul 22 17:17:57.603183 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.602976 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrlwl\" (UniqueName: \"kubernetes.io/projected/8895870b-2261-4c6f-9dea-1adb67052122-kube-api-access-zrlwl\") pod \"dns-default-g4n2l\" (UID: \"8895870b-2261-4c6f-9dea-1adb67052122\") " pod="openshift-dns/dns-default-g4n2l" Jul 22 17:17:57.603183 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.603018 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8895870b-2261-4c6f-9dea-1adb67052122-config-volume\") pod \"dns-default-g4n2l\" (UID: \"8895870b-2261-4c6f-9dea-1adb67052122\") " pod="openshift-dns/dns-default-g4n2l" Jul 22 17:17:57.704361 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.704325 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8895870b-2261-4c6f-9dea-1adb67052122-metrics-tls\") pod \"dns-default-g4n2l\" (UID: \"8895870b-2261-4c6f-9dea-1adb67052122\") " pod="openshift-dns/dns-default-g4n2l" Jul 22 17:17:57.704477 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.704373 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8895870b-2261-4c6f-9dea-1adb67052122-tmp-dir\") pod \"dns-default-g4n2l\" (UID: \"8895870b-2261-4c6f-9dea-1adb67052122\") " pod="openshift-dns/dns-default-g4n2l" Jul 22 17:17:57.704477 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.704399 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrlwl\" (UniqueName: \"kubernetes.io/projected/8895870b-2261-4c6f-9dea-1adb67052122-kube-api-access-zrlwl\") pod \"dns-default-g4n2l\" (UID: \"8895870b-2261-4c6f-9dea-1adb67052122\") " pod="openshift-dns/dns-default-g4n2l" Jul 22 17:17:57.704477 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.704428 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc6fs\" (UniqueName: \"kubernetes.io/projected/f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa-kube-api-access-zc6fs\") pod \"insights-runtime-extractor-hdsp4\" (UID: \"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa\") " pod="openshift-insights/insights-runtime-extractor-hdsp4" Jul 22 17:17:57.704477 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.704457 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8895870b-2261-4c6f-9dea-1adb67052122-config-volume\") pod \"dns-default-g4n2l\" (UID: \"8895870b-2261-4c6f-9dea-1adb67052122\") " pod="openshift-dns/dns-default-g4n2l" Jul 22 17:17:57.704638 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.704489 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hdsp4\" (UID: \"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa\") " pod="openshift-insights/insights-runtime-extractor-hdsp4" Jul 22 17:17:57.704638 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.704516 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa-crio-socket\") pod \"insights-runtime-extractor-hdsp4\" (UID: \"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa\") " pod="openshift-insights/insights-runtime-extractor-hdsp4" Jul 22 17:17:57.704638 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.704561 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa-data-volume\") pod \"insights-runtime-extractor-hdsp4\" (UID: \"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa\") " pod="openshift-insights/insights-runtime-extractor-hdsp4" Jul 22 17:17:57.704827 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.704715 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hdsp4\" (UID: \"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa\") " pod="openshift-insights/insights-runtime-extractor-hdsp4" Jul 22 17:17:57.704827 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.704798 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8895870b-2261-4c6f-9dea-1adb67052122-tmp-dir\") pod \"dns-default-g4n2l\" (UID: \"8895870b-2261-4c6f-9dea-1adb67052122\") " pod="openshift-dns/dns-default-g4n2l" Jul 22 17:17:57.704948 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.704826 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe005f0e-8f82-4f6e-a7d6-22df7ae6c4df-cert\") pod \"ingress-canary-hq6br\" (UID: \"fe005f0e-8f82-4f6e-a7d6-22df7ae6c4df\") " pod="openshift-ingress-canary/ingress-canary-hq6br" Jul 22 17:17:57.704948 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.704849 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gdrd\" (UniqueName: \"kubernetes.io/projected/fe005f0e-8f82-4f6e-a7d6-22df7ae6c4df-kube-api-access-7gdrd\") pod \"ingress-canary-hq6br\" (UID: \"fe005f0e-8f82-4f6e-a7d6-22df7ae6c4df\") " pod="openshift-ingress-canary/ingress-canary-hq6br" Jul 22 17:17:57.705201 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.705176 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8895870b-2261-4c6f-9dea-1adb67052122-config-volume\") pod \"dns-default-g4n2l\" (UID: \"8895870b-2261-4c6f-9dea-1adb67052122\") " pod="openshift-dns/dns-default-g4n2l" Jul 22 17:17:57.708365 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.708349 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8895870b-2261-4c6f-9dea-1adb67052122-metrics-tls\") pod \"dns-default-g4n2l\" (UID: \"8895870b-2261-4c6f-9dea-1adb67052122\") " pod="openshift-dns/dns-default-g4n2l" Jul 22 17:17:57.712590 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.712558 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrlwl\" (UniqueName: \"kubernetes.io/projected/8895870b-2261-4c6f-9dea-1adb67052122-kube-api-access-zrlwl\") pod \"dns-default-g4n2l\" (UID: \"8895870b-2261-4c6f-9dea-1adb67052122\") " pod="openshift-dns/dns-default-g4n2l" Jul 22 17:17:57.805678 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.805580 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hdsp4\" (UID: \"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa\") " pod="openshift-insights/insights-runtime-extractor-hdsp4" Jul 22 17:17:57.805678 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.805634 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa-crio-socket\") pod \"insights-runtime-extractor-hdsp4\" (UID: \"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa\") " pod="openshift-insights/insights-runtime-extractor-hdsp4" Jul 22 17:17:57.805987 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.805702 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa-crio-socket\") pod \"insights-runtime-extractor-hdsp4\" (UID: \"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa\") " pod="openshift-insights/insights-runtime-extractor-hdsp4" Jul 22 17:17:57.805987 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.805745 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa-data-volume\") pod \"insights-runtime-extractor-hdsp4\" (UID: \"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa\") " pod="openshift-insights/insights-runtime-extractor-hdsp4" Jul 22 17:17:57.805987 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.805800 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hdsp4\" (UID: \"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa\") " pod="openshift-insights/insights-runtime-extractor-hdsp4" Jul 22 17:17:57.805987 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.805846 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe005f0e-8f82-4f6e-a7d6-22df7ae6c4df-cert\") pod \"ingress-canary-hq6br\" (UID: \"fe005f0e-8f82-4f6e-a7d6-22df7ae6c4df\") " pod="openshift-ingress-canary/ingress-canary-hq6br" Jul 22 17:17:57.805987 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.805864 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gdrd\" (UniqueName: \"kubernetes.io/projected/fe005f0e-8f82-4f6e-a7d6-22df7ae6c4df-kube-api-access-7gdrd\") pod \"ingress-canary-hq6br\" (UID: \"fe005f0e-8f82-4f6e-a7d6-22df7ae6c4df\") " pod="openshift-ingress-canary/ingress-canary-hq6br" Jul 22 17:17:57.805987 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.805947 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc6fs\" (UniqueName: \"kubernetes.io/projected/f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa-kube-api-access-zc6fs\") pod \"insights-runtime-extractor-hdsp4\" (UID: \"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa\") " pod="openshift-insights/insights-runtime-extractor-hdsp4" Jul 22 17:17:57.806277 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.806030 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa-data-volume\") pod \"insights-runtime-extractor-hdsp4\" (UID: \"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa\") " pod="openshift-insights/insights-runtime-extractor-hdsp4" Jul 22 17:17:57.806277 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.806176 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hdsp4\" (UID: \"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa\") " pod="openshift-insights/insights-runtime-extractor-hdsp4" Jul 22 17:17:57.807403 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.807385 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g4n2l" Jul 22 17:17:57.808131 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.808101 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hdsp4\" (UID: \"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa\") " pod="openshift-insights/insights-runtime-extractor-hdsp4" Jul 22 17:17:57.808463 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.808443 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe005f0e-8f82-4f6e-a7d6-22df7ae6c4df-cert\") pod \"ingress-canary-hq6br\" (UID: \"fe005f0e-8f82-4f6e-a7d6-22df7ae6c4df\") " pod="openshift-ingress-canary/ingress-canary-hq6br" Jul 22 17:17:57.815170 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.815147 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gdrd\" (UniqueName: \"kubernetes.io/projected/fe005f0e-8f82-4f6e-a7d6-22df7ae6c4df-kube-api-access-7gdrd\") pod \"ingress-canary-hq6br\" (UID: \"fe005f0e-8f82-4f6e-a7d6-22df7ae6c4df\") " pod="openshift-ingress-canary/ingress-canary-hq6br" Jul 22 17:17:57.815652 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.815634 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc6fs\" (UniqueName: \"kubernetes.io/projected/f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa-kube-api-access-zc6fs\") pod \"insights-runtime-extractor-hdsp4\" (UID: \"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa\") " pod="openshift-insights/insights-runtime-extractor-hdsp4" Jul 22 17:17:57.858626 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.858595 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hq6br" Jul 22 17:17:57.968622 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:57.968591 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g4n2l"] Jul 22 17:17:57.971599 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:17:57.971572 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8895870b_2261_4c6f_9dea_1adb67052122.slice/crio-6bb6fceb6dc48d492ca24051d7c735d75aa13adaae0c1adb9599209b76f1e3fd WatchSource:0}: Error finding container 6bb6fceb6dc48d492ca24051d7c735d75aa13adaae0c1adb9599209b76f1e3fd: Status 404 returned error can't find the container with id 6bb6fceb6dc48d492ca24051d7c735d75aa13adaae0c1adb9599209b76f1e3fd Jul 22 17:17:58.006422 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:58.006395 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hq6br"] Jul 22 17:17:58.009644 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:17:58.009620 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe005f0e_8f82_4f6e_a7d6_22df7ae6c4df.slice/crio-e3d9b7d01ddb12ddae7427cd619cab3e70814d0ee7f993b443ff1da0dfe45749 WatchSource:0}: Error finding container e3d9b7d01ddb12ddae7427cd619cab3e70814d0ee7f993b443ff1da0dfe45749: Status 404 returned error can't find the container with id e3d9b7d01ddb12ddae7427cd619cab3e70814d0ee7f993b443ff1da0dfe45749 Jul 22 17:17:58.114862 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:58.114826 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hdsp4" Jul 22 17:17:58.235376 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:58.235344 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hdsp4"] Jul 22 17:17:58.238317 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:17:58.238295 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf59c6b9a_08a0_4772_9bf8_c5f5851cd8aa.slice/crio-197f602162aeb3d2740d6fb91e9605d30bccce0ecb4ed49fa93fa15db459f456 WatchSource:0}: Error finding container 197f602162aeb3d2740d6fb91e9605d30bccce0ecb4ed49fa93fa15db459f456: Status 404 returned error can't find the container with id 197f602162aeb3d2740d6fb91e9605d30bccce0ecb4ed49fa93fa15db459f456 Jul 22 17:17:58.545948 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:58.545854 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hdsp4" event={"ID":"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa","Type":"ContainerStarted","Data":"197f602162aeb3d2740d6fb91e9605d30bccce0ecb4ed49fa93fa15db459f456"} Jul 22 17:17:58.547205 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:58.547168 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hq6br" event={"ID":"fe005f0e-8f82-4f6e-a7d6-22df7ae6c4df","Type":"ContainerStarted","Data":"e3d9b7d01ddb12ddae7427cd619cab3e70814d0ee7f993b443ff1da0dfe45749"} Jul 22 17:17:58.548395 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:58.548362 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g4n2l" event={"ID":"8895870b-2261-4c6f-9dea-1adb67052122","Type":"ContainerStarted","Data":"6bb6fceb6dc48d492ca24051d7c735d75aa13adaae0c1adb9599209b76f1e3fd"} Jul 22 17:17:59.230446 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.230410 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:17:59.230639 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.230410 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:17:59.230742 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.230424 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:17:59.236484 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.236052 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 17:17:59.236484 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.236319 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 17:17:59.237122 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.237005 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tcfpj\"" Jul 22 17:17:59.237632 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.237281 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 17:17:59.237632 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.237474 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rvlz4\"" Jul 22 17:17:59.237632 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.237566 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 17:17:59.977944 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.977202 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-777c94b997-gnmwd"] Jul 22 17:17:59.979399 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.979374 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:17:59.983324 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.983135 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 22 17:17:59.983324 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.983192 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 17:17:59.985631 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.983716 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gnm9b\"" Jul 22 17:17:59.985631 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.984125 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 22 17:17:59.985631 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.984414 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 22 17:17:59.985631 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.984612 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 17:17:59.985631 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.984807 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 22 17:17:59.985631 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.984973 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 22 17:17:59.992924 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:17:59.992896 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-777c94b997-gnmwd"] Jul 22 17:18:00.024457 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.024137 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-oauth-serving-cert\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.024457 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.024190 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-config\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.024457 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.024240 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-oauth-config\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.024457 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.024289 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-serving-cert\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.024457 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.024357 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-service-ca\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.024457 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.024399 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2hrx\" (UniqueName: \"kubernetes.io/projected/d0719ca9-6f9c-4f31-8f11-5587c907137a-kube-api-access-j2hrx\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.125316 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.125283 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-service-ca\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.125484 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.125321 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2hrx\" (UniqueName: \"kubernetes.io/projected/d0719ca9-6f9c-4f31-8f11-5587c907137a-kube-api-access-j2hrx\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.125484 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.125372 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-oauth-serving-cert\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.125484 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.125397 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-config\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.125484 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.125424 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-oauth-config\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.125699 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.125607 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-serving-cert\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.126136 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.126110 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-service-ca\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.126406 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.126380 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-oauth-serving-cert\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.127188 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.127145 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-config\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.129410 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.129377 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-serving-cert\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.130157 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.129969 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-oauth-config\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.140664 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.140499 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2hrx\" (UniqueName: \"kubernetes.io/projected/d0719ca9-6f9c-4f31-8f11-5587c907137a-kube-api-access-j2hrx\") pod \"console-777c94b997-gnmwd\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.305210 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.305115 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:00.560325 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.560229 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g4n2l" event={"ID":"8895870b-2261-4c6f-9dea-1adb67052122","Type":"ContainerStarted","Data":"a0a8959c0c67a54815079c19887fd05ddc702e6f0eed53ddb243ccc0f06d730c"} Jul 22 17:18:00.560535 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.560342 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g4n2l" event={"ID":"8895870b-2261-4c6f-9dea-1adb67052122","Type":"ContainerStarted","Data":"6e598d7994ef12ab9d39d500edcda3770e16705b86f4b40e05972e286522d9b2"} Jul 22 17:18:00.560656 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.560590 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g4n2l" Jul 22 17:18:00.576988 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:00.576923 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g4n2l" podStartSLOduration=1.5869767609999998 podStartE2EDuration="3.576903402s" totalImagesPullingTime="1.989926641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:00.576355169 +0000 UTC m=+60.988080804" watchObservedRunningTime="2026-07-22 17:18:00.576903402 +0000 UTC m=+60.988629013" Jul 22 17:18:01.484022 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:01.483982 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5lb4" Jul 22 17:18:03.954726 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:03.954658 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-777c94b997-gnmwd"] Jul 22 17:18:03.960170 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:18:03.960136 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0719ca9_6f9c_4f31_8f11_5587c907137a.slice/crio-257484ab7090fbf2e033141fd593781c3049c9035c7f0beafe516d570f986176 WatchSource:0}: Error finding container 257484ab7090fbf2e033141fd593781c3049c9035c7f0beafe516d570f986176: Status 404 returned error can't find the container with id 257484ab7090fbf2e033141fd593781c3049c9035c7f0beafe516d570f986176 Jul 22 17:18:04.574590 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:04.574549 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hdsp4" event={"ID":"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa","Type":"ContainerStarted","Data":"1a4996d0a181951427af6a427c0a13b34a331652ede1e56878cb783575e7cd7f"} Jul 22 17:18:04.576396 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:04.576362 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hq6br" event={"ID":"fe005f0e-8f82-4f6e-a7d6-22df7ae6c4df","Type":"ContainerStarted","Data":"12ff4aa0e0a8e843aa1a741a06924eafe34363fe2394e4c622ae7b9602c038bf"} Jul 22 17:18:04.577867 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:04.577834 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777c94b997-gnmwd" event={"ID":"d0719ca9-6f9c-4f31-8f11-5587c907137a","Type":"ContainerStarted","Data":"257484ab7090fbf2e033141fd593781c3049c9035c7f0beafe516d570f986176"} Jul 22 17:18:04.592627 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:04.592248 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hq6br" podStartSLOduration=1.786663451 podStartE2EDuration="7.592229863s" totalImagesPullingTime="5.805566412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:04.591414381 +0000 UTC m=+65.003140011" watchObservedRunningTime="2026-07-22 17:18:04.592229863 +0000 UTC m=+65.003955474" Jul 22 17:18:04.950262 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:04.950224 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bb7fd8fb7-fhhg2"] Jul 22 17:18:04.952323 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:04.952293 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:04.963306 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:04.963226 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bb7fd8fb7-fhhg2"] Jul 22 17:18:04.963774 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:04.963740 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 22 17:18:05.064989 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.064942 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-oauth-config\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.064989 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.064994 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-config\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.065295 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.065059 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-service-ca\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.065295 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.065120 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkpck\" (UniqueName: \"kubernetes.io/projected/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-kube-api-access-qkpck\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.065295 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.065210 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-trusted-ca-bundle\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.065483 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.065315 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-serving-cert\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.065483 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.065346 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-oauth-serving-cert\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.166245 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.166204 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-serving-cert\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.166245 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.166252 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-oauth-serving-cert\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.166490 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.166300 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-oauth-config\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.166490 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.166319 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-config\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.166490 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.166346 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-service-ca\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.166490 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.166391 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkpck\" (UniqueName: \"kubernetes.io/projected/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-kube-api-access-qkpck\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.166490 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.166434 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-trusted-ca-bundle\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.167479 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.167429 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-service-ca\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.167609 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.167515 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-oauth-serving-cert\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.167696 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.167674 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-trusted-ca-bundle\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.167870 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.167849 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-config\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.169665 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.169631 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-oauth-config\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.169906 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.169887 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-serving-cert\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.174802 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.174745 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkpck\" (UniqueName: \"kubernetes.io/projected/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-kube-api-access-qkpck\") pod \"console-bb7fd8fb7-fhhg2\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.267092 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.267005 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:05.422756 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.422669 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bb7fd8fb7-fhhg2"] Jul 22 17:18:05.771753 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.771584 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs\") pod \"network-metrics-daemon-frsjr\" (UID: \"0e3de27a-4391-4543-a2c7-1eea25076ccb\") " pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:18:05.773868 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.773793 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 17:18:05.785140 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.785112 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e3de27a-4391-4543-a2c7-1eea25076ccb-metrics-certs\") pod \"network-metrics-daemon-frsjr\" (UID: \"0e3de27a-4391-4543-a2c7-1eea25076ccb\") " pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:18:05.847690 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.847660 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rvlz4\"" Jul 22 17:18:05.856667 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.856629 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frsjr" Jul 22 17:18:05.872409 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.872354 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret\") pod \"global-pull-secret-syncer-fgld8\" (UID: \"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f\") " pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:18:05.872588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.872424 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nv56\" (UniqueName: \"kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56\") pod \"network-check-target-xccc6\" (UID: \"04b8092a-803b-4ba2-be5a-db6df13a1bcc\") " pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:18:05.874635 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.874611 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 17:18:05.874796 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.874739 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 17:18:05.885337 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.885294 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 17:18:05.886180 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.886141 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b241b6ee-11fc-44f8-b76d-2b13f6aafc5f-original-pull-secret\") pod \"global-pull-secret-syncer-fgld8\" (UID: \"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f\") " pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:18:05.896498 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:05.896467 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nv56\" (UniqueName: \"kubernetes.io/projected/04b8092a-803b-4ba2-be5a-db6df13a1bcc-kube-api-access-4nv56\") pod \"network-check-target-xccc6\" (UID: \"04b8092a-803b-4ba2-be5a-db6df13a1bcc\") " pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:18:06.154123 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:06.154085 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fgld8" Jul 22 17:18:06.168924 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:06.168892 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tcfpj\"" Jul 22 17:18:06.177339 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:06.177072 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:18:06.777922 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:18:06.777889 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20d0bd9_797b_4c50_9a55_7e9aea3b4461.slice/crio-8f447929a9ea20447a990468fc714c23f80e3281fa3e419bd70af0555f3e4649 WatchSource:0}: Error finding container 8f447929a9ea20447a990468fc714c23f80e3281fa3e419bd70af0555f3e4649: Status 404 returned error can't find the container with id 8f447929a9ea20447a990468fc714c23f80e3281fa3e419bd70af0555f3e4649 Jul 22 17:18:07.587571 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:07.587535 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb7fd8fb7-fhhg2" event={"ID":"a20d0bd9-797b-4c50-9a55-7e9aea3b4461","Type":"ContainerStarted","Data":"8f447929a9ea20447a990468fc714c23f80e3281fa3e419bd70af0555f3e4649"} Jul 22 17:18:08.599529 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:08.598077 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hdsp4" event={"ID":"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa","Type":"ContainerStarted","Data":"25bc79aa4ee4ae976793dba5ebf7f4f086b0ddde1e91f45f340b0e3187f2a0a3"} Jul 22 17:18:08.603688 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:08.603614 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777c94b997-gnmwd" event={"ID":"d0719ca9-6f9c-4f31-8f11-5587c907137a","Type":"ContainerStarted","Data":"0e10430735063f0d8828b959a2525af065fdc6718b7534f4677b628034c1be1e"} Jul 22 17:18:08.608155 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:08.607931 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb7fd8fb7-fhhg2" event={"ID":"a20d0bd9-797b-4c50-9a55-7e9aea3b4461","Type":"ContainerStarted","Data":"d9d5a0330a8b33c22a0bbc6a7a6ddde83e302836d35db03ec8f9cc30ce0d0efb"} Jul 22 17:18:08.618317 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:08.618251 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xccc6"] Jul 22 17:18:08.623703 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:18:08.623668 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b8092a_803b_4ba2_be5a_db6df13a1bcc.slice/crio-13c0c2e3fb7cefacf7a78b31fc181b9dc3a77e51a939f19e536cdca717f9f337 WatchSource:0}: Error finding container 13c0c2e3fb7cefacf7a78b31fc181b9dc3a77e51a939f19e536cdca717f9f337: Status 404 returned error can't find the container with id 13c0c2e3fb7cefacf7a78b31fc181b9dc3a77e51a939f19e536cdca717f9f337 Jul 22 17:18:08.650033 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:08.649977 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-777c94b997-gnmwd" podStartSLOduration=5.145827227 podStartE2EDuration="9.649958768s" totalImagesPullingTime="4.504131541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:08.623995902 +0000 UTC m=+69.035721536" watchObservedRunningTime="2026-07-22 17:18:08.649958768 +0000 UTC m=+69.061684371" Jul 22 17:18:08.651253 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:08.651215 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bb7fd8fb7-fhhg2" podStartSLOduration=2.96231263 podStartE2EDuration="4.651205381s" totalImagesPullingTime="1.688892751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:08.649467093 +0000 UTC m=+69.061192701" watchObservedRunningTime="2026-07-22 17:18:08.651205381 +0000 UTC m=+69.062930990" Jul 22 17:18:08.651400 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:08.651320 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-frsjr"] Jul 22 17:18:08.655570 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:18:08.655547 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e3de27a_4391_4543_a2c7_1eea25076ccb.slice/crio-9f6ac3f6ce0862a1b9f3da3f217060e9bcc07ef45a9d690dbb92983fafa5e961 WatchSource:0}: Error finding container 9f6ac3f6ce0862a1b9f3da3f217060e9bcc07ef45a9d690dbb92983fafa5e961: Status 404 returned error can't find the container with id 9f6ac3f6ce0862a1b9f3da3f217060e9bcc07ef45a9d690dbb92983fafa5e961 Jul 22 17:18:08.671636 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:08.671605 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fgld8"] Jul 22 17:18:08.675225 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:18:08.675189 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb241b6ee_11fc_44f8_b76d_2b13f6aafc5f.slice/crio-eebfbf465656935881bc36b834be75395ed6a098fb513d86d4a023324872e3ce WatchSource:0}: Error finding container eebfbf465656935881bc36b834be75395ed6a098fb513d86d4a023324872e3ce: Status 404 returned error can't find the container with id eebfbf465656935881bc36b834be75395ed6a098fb513d86d4a023324872e3ce Jul 22 17:18:09.615439 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:09.615398 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xccc6" event={"ID":"04b8092a-803b-4ba2-be5a-db6df13a1bcc","Type":"ContainerStarted","Data":"13c0c2e3fb7cefacf7a78b31fc181b9dc3a77e51a939f19e536cdca717f9f337"} Jul 22 17:18:09.618153 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:09.618116 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fgld8" event={"ID":"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f","Type":"ContainerStarted","Data":"eebfbf465656935881bc36b834be75395ed6a098fb513d86d4a023324872e3ce"} Jul 22 17:18:09.620270 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:09.620242 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-frsjr" event={"ID":"0e3de27a-4391-4543-a2c7-1eea25076ccb","Type":"ContainerStarted","Data":"9f6ac3f6ce0862a1b9f3da3f217060e9bcc07ef45a9d690dbb92983fafa5e961"} Jul 22 17:18:10.305410 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:10.305355 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:10.305625 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:10.305436 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:10.312143 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:10.312053 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:10.567116 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:10.566468 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g4n2l" Jul 22 17:18:10.630950 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:10.630895 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-frsjr" event={"ID":"0e3de27a-4391-4543-a2c7-1eea25076ccb","Type":"ContainerStarted","Data":"d2a6c06564ed73de33698ae0724181e5a558dc6101285a5bb90e5a9af2c5a196"} Jul 22 17:18:10.638172 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:10.638011 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:11.638552 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:11.638491 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-frsjr" event={"ID":"0e3de27a-4391-4543-a2c7-1eea25076ccb","Type":"ContainerStarted","Data":"e07b1875bbe8bd75a1d088f77a5bc91f1ae9f0de44f1b28fe763b3955adc2764"} Jul 22 17:18:11.656774 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:11.656697 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-frsjr" podStartSLOduration=69.915535683 podStartE2EDuration="1m11.656675378s" totalImagesPullingTime="1.741139695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:11.655019155 +0000 UTC m=+72.066744768" watchObservedRunningTime="2026-07-22 17:18:11.656675378 +0000 UTC m=+72.068400988" Jul 22 17:18:15.268840 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:15.268776 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:15.269354 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:15.268864 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:15.273700 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:15.273669 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:15.652971 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:15.652928 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fgld8" event={"ID":"b241b6ee-11fc-44f8-b76d-2b13f6aafc5f","Type":"ContainerStarted","Data":"b1bf193e1d08e176c7c01bfe4fa50d2b4f63023be15bbf22e815c1daaaab8829"} Jul 22 17:18:15.654998 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:15.654970 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hdsp4" event={"ID":"f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa","Type":"ContainerStarted","Data":"c5f02bae2a601ebb32e33b2a516bff21034d2de9222e39fce862eafdc83aacc6"} Jul 22 17:18:15.656212 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:15.656186 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xccc6" event={"ID":"04b8092a-803b-4ba2-be5a-db6df13a1bcc","Type":"ContainerStarted","Data":"7030e423181b3f45251ccacd9f46bae15094580f225184b7eea10ce0ee397f38"} Jul 22 17:18:15.659977 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:15.659958 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:18:15.667242 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:15.667197 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fgld8" podStartSLOduration=69.209831754 podStartE2EDuration="1m15.667182587s" totalImagesPullingTime="6.457350833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:15.666428625 +0000 UTC m=+76.078154234" watchObservedRunningTime="2026-07-22 17:18:15.667182587 +0000 UTC m=+76.078908196" Jul 22 17:18:15.679815 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:15.679742 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xccc6" podStartSLOduration=69.17623675 podStartE2EDuration="1m15.679724282s" totalImagesPullingTime="6.503487532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:15.679388542 +0000 UTC m=+76.091114151" watchObservedRunningTime="2026-07-22 17:18:15.679724282 +0000 UTC m=+76.091449892" Jul 22 17:18:15.697135 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:15.697083 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hdsp4" podStartSLOduration=1.993922427 podStartE2EDuration="18.697068827s" totalImagesPullingTime="16.7031464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:15.695698643 +0000 UTC m=+76.107424270" watchObservedRunningTime="2026-07-22 17:18:15.697068827 +0000 UTC m=+76.108794466" Jul 22 17:18:15.742363 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:15.742331 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-777c94b997-gnmwd"] Jul 22 17:18:16.659242 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:16.659205 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:18:17.255827 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.255794 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx"] Jul 22 17:18:17.258885 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.258866 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" Jul 22 17:18:17.262139 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.262117 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 22 17:18:17.262944 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.262927 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 17:18:17.263057 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.263040 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 17:18:17.266389 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.266370 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 22 17:18:17.267022 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.267008 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 17:18:17.267328 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.267313 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zqdwz\"" Jul 22 17:18:17.280853 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.280821 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx"] Jul 22 17:18:17.320088 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.320058 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8km9n"] Jul 22 17:18:17.323182 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.323163 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.325515 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.325492 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 17:18:17.325791 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.325775 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 17:18:17.326219 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.326200 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 17:18:17.326421 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.326407 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f75mp\"" Jul 22 17:18:17.360646 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.360612 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.360646 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.360648 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/836bd8bb-0686-4a73-98e8-96fae123288d-sys\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.360916 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.360667 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-wtmp\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.360916 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.360688 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/836bd8bb-0686-4a73-98e8-96fae123288d-metrics-client-ca\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.360916 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.360733 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmb29\" (UniqueName: \"kubernetes.io/projected/76986bfe-f808-4481-8883-5167f73667f3-kube-api-access-pmb29\") pod \"openshift-state-metrics-79f6958cdf-cwmpx\" (UID: \"76986bfe-f808-4481-8883-5167f73667f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" Jul 22 17:18:17.360916 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.360793 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/836bd8bb-0686-4a73-98e8-96fae123288d-root\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.360916 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.360825 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76986bfe-f808-4481-8883-5167f73667f3-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-cwmpx\" (UID: \"76986bfe-f808-4481-8883-5167f73667f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" Jul 22 17:18:17.360916 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.360845 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-accelerators-collector-config\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.360916 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.360878 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m29l\" (UniqueName: \"kubernetes.io/projected/836bd8bb-0686-4a73-98e8-96fae123288d-kube-api-access-6m29l\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.360916 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.360912 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-textfile\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.361157 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.360944 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76986bfe-f808-4481-8883-5167f73667f3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-cwmpx\" (UID: \"76986bfe-f808-4481-8883-5167f73667f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" Jul 22 17:18:17.361157 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.360959 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-tls\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.361157 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.360976 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/76986bfe-f808-4481-8883-5167f73667f3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-cwmpx\" (UID: \"76986bfe-f808-4481-8883-5167f73667f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" Jul 22 17:18:17.461830 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.461792 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/836bd8bb-0686-4a73-98e8-96fae123288d-metrics-client-ca\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.461830 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.461827 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmb29\" (UniqueName: \"kubernetes.io/projected/76986bfe-f808-4481-8883-5167f73667f3-kube-api-access-pmb29\") pod \"openshift-state-metrics-79f6958cdf-cwmpx\" (UID: \"76986bfe-f808-4481-8883-5167f73667f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" Jul 22 17:18:17.462043 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.461935 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/836bd8bb-0686-4a73-98e8-96fae123288d-root\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.462043 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.461974 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76986bfe-f808-4481-8883-5167f73667f3-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-cwmpx\" (UID: \"76986bfe-f808-4481-8883-5167f73667f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" Jul 22 17:18:17.462043 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.461994 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-accelerators-collector-config\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.462043 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.462028 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m29l\" (UniqueName: \"kubernetes.io/projected/836bd8bb-0686-4a73-98e8-96fae123288d-kube-api-access-6m29l\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.462276 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.462042 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/836bd8bb-0686-4a73-98e8-96fae123288d-root\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.462276 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.462063 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-textfile\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.462276 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.462120 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76986bfe-f808-4481-8883-5167f73667f3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-cwmpx\" (UID: \"76986bfe-f808-4481-8883-5167f73667f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" Jul 22 17:18:17.462276 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.462155 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-tls\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.462276 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.462187 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/76986bfe-f808-4481-8883-5167f73667f3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-cwmpx\" (UID: \"76986bfe-f808-4481-8883-5167f73667f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" Jul 22 17:18:17.462276 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.462218 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.462276 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.462257 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/836bd8bb-0686-4a73-98e8-96fae123288d-sys\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.462646 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.462287 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-wtmp\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.462646 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.462312 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-textfile\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.462646 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:18:17.462359 2566 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 22 17:18:17.462646 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:18:17.462419 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76986bfe-f808-4481-8883-5167f73667f3-openshift-state-metrics-tls podName:76986bfe-f808-4481-8883-5167f73667f3 nodeName:}" failed. No retries permitted until 2026-07-22 17:18:17.962398603 +0000 UTC m=+78.374124193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/76986bfe-f808-4481-8883-5167f73667f3-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-cwmpx" (UID: "76986bfe-f808-4481-8883-5167f73667f3") : secret "openshift-state-metrics-tls" not found Jul 22 17:18:17.462646 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.462435 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-wtmp\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.462646 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.462481 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/836bd8bb-0686-4a73-98e8-96fae123288d-sys\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.462646 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.462498 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/836bd8bb-0686-4a73-98e8-96fae123288d-metrics-client-ca\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.462646 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:18:17.462567 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 22 17:18:17.462646 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.462570 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-accelerators-collector-config\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.462646 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:18:17.462623 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-tls podName:836bd8bb-0686-4a73-98e8-96fae123288d nodeName:}" failed. No retries permitted until 2026-07-22 17:18:17.96260458 +0000 UTC m=+78.374330169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-tls") pod "node-exporter-8km9n" (UID: "836bd8bb-0686-4a73-98e8-96fae123288d") : secret "node-exporter-tls" not found Jul 22 17:18:17.463016 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.462689 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76986bfe-f808-4481-8883-5167f73667f3-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-cwmpx\" (UID: \"76986bfe-f808-4481-8883-5167f73667f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" Jul 22 17:18:17.464484 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.464465 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.464599 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.464582 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76986bfe-f808-4481-8883-5167f73667f3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-cwmpx\" (UID: \"76986bfe-f808-4481-8883-5167f73667f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" Jul 22 17:18:17.471747 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.471723 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m29l\" (UniqueName: \"kubernetes.io/projected/836bd8bb-0686-4a73-98e8-96fae123288d-kube-api-access-6m29l\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.472179 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.472159 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmb29\" (UniqueName: \"kubernetes.io/projected/76986bfe-f808-4481-8883-5167f73667f3-kube-api-access-pmb29\") pod \"openshift-state-metrics-79f6958cdf-cwmpx\" (UID: \"76986bfe-f808-4481-8883-5167f73667f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" Jul 22 17:18:17.965874 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.965833 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-tls\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:17.965874 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.965878 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/76986bfe-f808-4481-8883-5167f73667f3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-cwmpx\" (UID: \"76986bfe-f808-4481-8883-5167f73667f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" Jul 22 17:18:17.966322 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:18:17.965996 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 22 17:18:17.966322 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:18:17.966074 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-tls podName:836bd8bb-0686-4a73-98e8-96fae123288d nodeName:}" failed. No retries permitted until 2026-07-22 17:18:18.966056693 +0000 UTC m=+79.377782289 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-tls") pod "node-exporter-8km9n" (UID: "836bd8bb-0686-4a73-98e8-96fae123288d") : secret "node-exporter-tls" not found Jul 22 17:18:17.968246 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:17.968224 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/76986bfe-f808-4481-8883-5167f73667f3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-cwmpx\" (UID: \"76986bfe-f808-4481-8883-5167f73667f3\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" Jul 22 17:18:18.167414 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:18.167376 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" Jul 22 17:18:18.327249 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:18.327211 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx"] Jul 22 17:18:18.330260 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:18:18.330234 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76986bfe_f808_4481_8883_5167f73667f3.slice/crio-eee81ad400d994116b59fd63806d4b65563df39d3129d2e7b12cd381b03126e4 WatchSource:0}: Error finding container eee81ad400d994116b59fd63806d4b65563df39d3129d2e7b12cd381b03126e4: Status 404 returned error can't find the container with id eee81ad400d994116b59fd63806d4b65563df39d3129d2e7b12cd381b03126e4 Jul 22 17:18:18.667481 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:18.667444 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" event={"ID":"76986bfe-f808-4481-8883-5167f73667f3","Type":"ContainerStarted","Data":"f638cd78e1ac4d00939b774e4ba7edf30828477a3d6d2d25bc251aef57cd655f"} Jul 22 17:18:18.667652 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:18.667502 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" event={"ID":"76986bfe-f808-4481-8883-5167f73667f3","Type":"ContainerStarted","Data":"8a73496b6ba0d44cc2661cd8b09736d5d4829f0930857e81b172b775c0776826"} Jul 22 17:18:18.667652 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:18.667521 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" event={"ID":"76986bfe-f808-4481-8883-5167f73667f3","Type":"ContainerStarted","Data":"eee81ad400d994116b59fd63806d4b65563df39d3129d2e7b12cd381b03126e4"} Jul 22 17:18:18.974247 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:18.974155 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-tls\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:18.976552 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:18.976532 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/836bd8bb-0686-4a73-98e8-96fae123288d-node-exporter-tls\") pod \"node-exporter-8km9n\" (UID: \"836bd8bb-0686-4a73-98e8-96fae123288d\") " pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:19.131937 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:19.131899 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8km9n" Jul 22 17:18:19.143798 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:18:19.143746 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod836bd8bb_0686_4a73_98e8_96fae123288d.slice/crio-d0d5a33faa3430a5d615d68cd1bc3dffd2baebc5b77f68a5076d5744c1cea4b4 WatchSource:0}: Error finding container d0d5a33faa3430a5d615d68cd1bc3dffd2baebc5b77f68a5076d5744c1cea4b4: Status 404 returned error can't find the container with id d0d5a33faa3430a5d615d68cd1bc3dffd2baebc5b77f68a5076d5744c1cea4b4 Jul 22 17:18:19.674240 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:19.674211 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8km9n" event={"ID":"836bd8bb-0686-4a73-98e8-96fae123288d","Type":"ContainerStarted","Data":"d0d5a33faa3430a5d615d68cd1bc3dffd2baebc5b77f68a5076d5744c1cea4b4"} Jul 22 17:18:20.226331 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.226293 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7dcbc884dc-dbf59"] Jul 22 17:18:20.235552 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.235511 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.237948 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.237918 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-p4q22\"" Jul 22 17:18:20.237948 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.237933 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 22 17:18:20.238136 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.237962 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 22 17:18:20.238136 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.237918 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 22 17:18:20.238256 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.238240 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 22 17:18:20.238344 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.238268 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8u54u31im7j75\"" Jul 22 17:18:20.238344 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.238286 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 22 17:18:20.247022 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.246992 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dcbc884dc-dbf59"] Jul 22 17:18:20.285074 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.285034 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.285240 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.285094 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72a999a7-bc35-4e29-9d9b-3a5b51482c17-metrics-client-ca\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.285240 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.285162 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.285368 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.285248 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.285368 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.285289 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-thanos-querier-tls\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.285368 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.285318 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-grpc-tls\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.285368 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.285341 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxmgf\" (UniqueName: \"kubernetes.io/projected/72a999a7-bc35-4e29-9d9b-3a5b51482c17-kube-api-access-pxmgf\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.285526 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.285420 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.386377 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.386345 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.386473 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.386411 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.386473 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.386441 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-thanos-querier-tls\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.386564 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.386472 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-grpc-tls\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.386564 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.386494 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxmgf\" (UniqueName: \"kubernetes.io/projected/72a999a7-bc35-4e29-9d9b-3a5b51482c17-kube-api-access-pxmgf\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.386564 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.386525 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.386723 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.386569 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.386723 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.386626 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72a999a7-bc35-4e29-9d9b-3a5b51482c17-metrics-client-ca\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.387437 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.387404 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72a999a7-bc35-4e29-9d9b-3a5b51482c17-metrics-client-ca\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.389194 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.389154 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.389434 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.389414 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.389510 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.389420 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.389510 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.389468 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-thanos-querier-tls\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.389510 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.389496 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-grpc-tls\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.389807 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.389789 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72a999a7-bc35-4e29-9d9b-3a5b51482c17-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.393589 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.393565 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxmgf\" (UniqueName: \"kubernetes.io/projected/72a999a7-bc35-4e29-9d9b-3a5b51482c17-kube-api-access-pxmgf\") pod \"thanos-querier-7dcbc884dc-dbf59\" (UID: \"72a999a7-bc35-4e29-9d9b-3a5b51482c17\") " pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.548016 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.547978 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:20.679406 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.679361 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" event={"ID":"76986bfe-f808-4481-8883-5167f73667f3","Type":"ContainerStarted","Data":"b183836b4c5f10ec76fc114ae8d83360b1a7a908d7adb87d74492b89fc08cf41"} Jul 22 17:18:20.680896 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.680869 2566 generic.go:356] "Generic (PLEG): container finished" podID="836bd8bb-0686-4a73-98e8-96fae123288d" containerID="d68b0edbff49087d1de491d369a669e601e49595bcb5e9eb62646ec5b2bfd3a0" exitCode=0 Jul 22 17:18:20.681025 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.680920 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8km9n" event={"ID":"836bd8bb-0686-4a73-98e8-96fae123288d","Type":"ContainerDied","Data":"d68b0edbff49087d1de491d369a669e601e49595bcb5e9eb62646ec5b2bfd3a0"} Jul 22 17:18:20.683267 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.683176 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dcbc884dc-dbf59"] Jul 22 17:18:20.686592 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:18:20.686552 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72a999a7_bc35_4e29_9d9b_3a5b51482c17.slice/crio-64d89092e5953fd8eeb930a90e836cf5a444d1fd0e035b76a0b0a1f9ac1d36f0 WatchSource:0}: Error finding container 64d89092e5953fd8eeb930a90e836cf5a444d1fd0e035b76a0b0a1f9ac1d36f0: Status 404 returned error can't find the container with id 64d89092e5953fd8eeb930a90e836cf5a444d1fd0e035b76a0b0a1f9ac1d36f0 Jul 22 17:18:20.697160 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:20.696504 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-cwmpx" podStartSLOduration=2.5221136570000002 podStartE2EDuration="3.696485043s" totalImagesPullingTime="1.174371386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:20.69543191 +0000 UTC m=+81.107157519" watchObservedRunningTime="2026-07-22 17:18:20.696485043 +0000 UTC m=+81.108210653" Jul 22 17:18:21.532159 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.532032 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7944974dc6-n7d5m"] Jul 22 17:18:21.535519 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.535496 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.538370 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.538343 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-svncj\"" Jul 22 17:18:21.538527 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.538357 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 22 17:18:21.538632 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.538613 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 22 17:18:21.538689 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.538645 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-pds7g9sed7el\"" Jul 22 17:18:21.538689 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.538512 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 22 17:18:21.538689 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.538681 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 22 17:18:21.544608 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.544584 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7944974dc6-n7d5m"] Jul 22 17:18:21.596167 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.596130 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5af19be2-849c-44a3-9a9e-65b1d009db02-audit-log\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.596167 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.596171 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5af19be2-849c-44a3-9a9e-65b1d009db02-secret-metrics-server-client-certs\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.596407 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.596245 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5af19be2-849c-44a3-9a9e-65b1d009db02-metrics-server-audit-profiles\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.596407 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.596284 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5af19be2-849c-44a3-9a9e-65b1d009db02-client-ca-bundle\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.596407 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.596359 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af19be2-849c-44a3-9a9e-65b1d009db02-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.596407 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.596401 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5af19be2-849c-44a3-9a9e-65b1d009db02-secret-metrics-server-tls\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.596568 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.596469 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9dcg\" (UniqueName: \"kubernetes.io/projected/5af19be2-849c-44a3-9a9e-65b1d009db02-kube-api-access-r9dcg\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.687231 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.687191 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8km9n" event={"ID":"836bd8bb-0686-4a73-98e8-96fae123288d","Type":"ContainerStarted","Data":"77bb931490f07a35aedd74316b57b55e4027a277da59d015a4ad8b7e59cb9c7c"} Jul 22 17:18:21.687411 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.687297 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8km9n" event={"ID":"836bd8bb-0686-4a73-98e8-96fae123288d","Type":"ContainerStarted","Data":"a744bd674b1659f02034779b7af57fd69e43d2c8b4749acbaabe07afbea77033"} Jul 22 17:18:21.688615 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.688589 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" event={"ID":"72a999a7-bc35-4e29-9d9b-3a5b51482c17","Type":"ContainerStarted","Data":"64d89092e5953fd8eeb930a90e836cf5a444d1fd0e035b76a0b0a1f9ac1d36f0"} Jul 22 17:18:21.697114 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.697087 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5af19be2-849c-44a3-9a9e-65b1d009db02-audit-log\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.697239 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.697122 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5af19be2-849c-44a3-9a9e-65b1d009db02-secret-metrics-server-client-certs\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.697239 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.697155 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5af19be2-849c-44a3-9a9e-65b1d009db02-metrics-server-audit-profiles\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.697239 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.697173 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5af19be2-849c-44a3-9a9e-65b1d009db02-client-ca-bundle\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.697239 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.697221 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af19be2-849c-44a3-9a9e-65b1d009db02-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.697451 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.697245 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5af19be2-849c-44a3-9a9e-65b1d009db02-secret-metrics-server-tls\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.697451 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.697276 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9dcg\" (UniqueName: \"kubernetes.io/projected/5af19be2-849c-44a3-9a9e-65b1d009db02-kube-api-access-r9dcg\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.697559 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.697444 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5af19be2-849c-44a3-9a9e-65b1d009db02-audit-log\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.698267 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.698239 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5af19be2-849c-44a3-9a9e-65b1d009db02-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.698384 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.698355 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5af19be2-849c-44a3-9a9e-65b1d009db02-metrics-server-audit-profiles\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.700265 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.700241 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5af19be2-849c-44a3-9a9e-65b1d009db02-client-ca-bundle\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.700367 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.700305 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5af19be2-849c-44a3-9a9e-65b1d009db02-secret-metrics-server-client-certs\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.700430 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.700420 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5af19be2-849c-44a3-9a9e-65b1d009db02-secret-metrics-server-tls\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.705240 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.705218 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9dcg\" (UniqueName: \"kubernetes.io/projected/5af19be2-849c-44a3-9a9e-65b1d009db02-kube-api-access-r9dcg\") pod \"metrics-server-7944974dc6-n7d5m\" (UID: \"5af19be2-849c-44a3-9a9e-65b1d009db02\") " pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.708105 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.708053 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8km9n" podStartSLOduration=3.423797728 podStartE2EDuration="4.708033833s" totalImagesPullingTime="1.218483703s" totalInitContainerRuntime="65.752402ms" isStatefulPod=true podCreationTimestamp="2026-07-22 17:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:21.706630329 +0000 UTC m=+82.118355931" watchObservedRunningTime="2026-07-22 17:18:21.708033833 +0000 UTC m=+82.119759438" Jul 22 17:18:21.847486 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.847453 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:21.881887 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.881843 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6874db97cb-b2v45"] Jul 22 17:18:21.886502 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.886461 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:21.896702 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.896118 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6874db97cb-b2v45"] Jul 22 17:18:21.988358 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:21.988324 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7944974dc6-n7d5m"] Jul 22 17:18:21.991852 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:18:21.991821 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5af19be2_849c_44a3_9a9e_65b1d009db02.slice/crio-ed2e070a16d43576f5dc0c0748599417277aff12322cf9e4140b78f21326ebd3 WatchSource:0}: Error finding container ed2e070a16d43576f5dc0c0748599417277aff12322cf9e4140b78f21326ebd3: Status 404 returned error can't find the container with id ed2e070a16d43576f5dc0c0748599417277aff12322cf9e4140b78f21326ebd3 Jul 22 17:18:22.000038 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.000011 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-oauth-serving-cert\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.000141 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.000056 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-config\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.000141 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.000129 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-trusted-ca-bundle\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.000267 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.000158 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-oauth-config\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.000267 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.000232 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-service-ca\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.000361 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.000268 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfvc9\" (UniqueName: \"kubernetes.io/projected/47d1febd-d2a1-4056-8cec-fc197f47bb88-kube-api-access-gfvc9\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.000361 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.000331 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-serving-cert\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.101419 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.101317 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-trusted-ca-bundle\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.101419 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.101360 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-oauth-config\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.101419 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.101384 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-service-ca\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.101419 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.101400 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfvc9\" (UniqueName: \"kubernetes.io/projected/47d1febd-d2a1-4056-8cec-fc197f47bb88-kube-api-access-gfvc9\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.101685 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.101433 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-serving-cert\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.101685 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.101474 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-oauth-serving-cert\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.101685 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.101499 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-config\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.102350 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.102320 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-service-ca\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.102350 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.102341 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-config\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.102548 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.102457 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-oauth-serving-cert\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.102548 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.102461 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-trusted-ca-bundle\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.103996 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.103965 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-serving-cert\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.104087 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.104020 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-oauth-config\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.109472 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.109453 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfvc9\" (UniqueName: \"kubernetes.io/projected/47d1febd-d2a1-4056-8cec-fc197f47bb88-kube-api-access-gfvc9\") pod \"console-6874db97cb-b2v45\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.200391 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.200349 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:22.498150 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.498041 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-56895fb4fb-472jd"] Jul 22 17:18:22.501778 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.501739 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.504081 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.504036 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hrmks\"" Jul 22 17:18:22.504214 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.504048 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 22 17:18:22.504288 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.504279 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 22 17:18:22.504630 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.504493 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 22 17:18:22.504630 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.504509 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 22 17:18:22.504824 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.504803 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 22 17:18:22.510013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.509982 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 22 17:18:22.517536 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.517508 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56895fb4fb-472jd"] Jul 22 17:18:22.605110 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.605076 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56c6e577-9823-4055-9799-0dbb1a6d2448-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.605553 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.605139 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/56c6e577-9823-4055-9799-0dbb1a6d2448-secret-telemeter-client\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.605553 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.605210 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/56c6e577-9823-4055-9799-0dbb1a6d2448-federate-client-tls\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.605553 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.605267 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56c6e577-9823-4055-9799-0dbb1a6d2448-metrics-client-ca\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.605553 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.605293 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56c6e577-9823-4055-9799-0dbb1a6d2448-serving-certs-ca-bundle\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.605553 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.605340 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56c6e577-9823-4055-9799-0dbb1a6d2448-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.605553 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.605382 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/56c6e577-9823-4055-9799-0dbb1a6d2448-telemeter-client-tls\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.605553 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.605447 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzc76\" (UniqueName: \"kubernetes.io/projected/56c6e577-9823-4055-9799-0dbb1a6d2448-kube-api-access-dzc76\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.694959 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.694924 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" event={"ID":"5af19be2-849c-44a3-9a9e-65b1d009db02","Type":"ContainerStarted","Data":"ed2e070a16d43576f5dc0c0748599417277aff12322cf9e4140b78f21326ebd3"} Jul 22 17:18:22.706611 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.706572 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/56c6e577-9823-4055-9799-0dbb1a6d2448-federate-client-tls\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.706791 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.706631 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56c6e577-9823-4055-9799-0dbb1a6d2448-metrics-client-ca\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.706791 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.706651 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56c6e577-9823-4055-9799-0dbb1a6d2448-serving-certs-ca-bundle\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.706903 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.706798 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56c6e577-9823-4055-9799-0dbb1a6d2448-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.706903 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.706834 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/56c6e577-9823-4055-9799-0dbb1a6d2448-telemeter-client-tls\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.706903 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.706863 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzc76\" (UniqueName: \"kubernetes.io/projected/56c6e577-9823-4055-9799-0dbb1a6d2448-kube-api-access-dzc76\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.706903 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.706896 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56c6e577-9823-4055-9799-0dbb1a6d2448-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.707107 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.706941 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/56c6e577-9823-4055-9799-0dbb1a6d2448-secret-telemeter-client\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.707660 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.707509 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56c6e577-9823-4055-9799-0dbb1a6d2448-metrics-client-ca\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.707660 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.707587 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56c6e577-9823-4055-9799-0dbb1a6d2448-serving-certs-ca-bundle\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.709173 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.709141 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56c6e577-9823-4055-9799-0dbb1a6d2448-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.709897 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.709870 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/56c6e577-9823-4055-9799-0dbb1a6d2448-secret-telemeter-client\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.709996 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.709958 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/56c6e577-9823-4055-9799-0dbb1a6d2448-federate-client-tls\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.712785 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.711708 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56c6e577-9823-4055-9799-0dbb1a6d2448-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.715918 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.715896 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/56c6e577-9823-4055-9799-0dbb1a6d2448-telemeter-client-tls\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.720103 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.720082 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzc76\" (UniqueName: \"kubernetes.io/projected/56c6e577-9823-4055-9799-0dbb1a6d2448-kube-api-access-dzc76\") pod \"telemeter-client-56895fb4fb-472jd\" (UID: \"56c6e577-9823-4055-9799-0dbb1a6d2448\") " pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.813643 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.813612 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" Jul 22 17:18:22.831732 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.831701 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6874db97cb-b2v45"] Jul 22 17:18:22.834895 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:18:22.834868 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d1febd_d2a1_4056_8cec_fc197f47bb88.slice/crio-f78ff8e518c91827c477942786dc817f1fbfb7b7933c8d9f478313f0bdf96ea1 WatchSource:0}: Error finding container f78ff8e518c91827c477942786dc817f1fbfb7b7933c8d9f478313f0bdf96ea1: Status 404 returned error can't find the container with id f78ff8e518c91827c477942786dc817f1fbfb7b7933c8d9f478313f0bdf96ea1 Jul 22 17:18:22.995155 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:22.995119 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56895fb4fb-472jd"] Jul 22 17:18:22.999217 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:18:22.999123 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56c6e577_9823_4055_9799_0dbb1a6d2448.slice/crio-37a7bbb4e5833bc0e9b46191204b7c6fbff24db23aa701a4711336c3c8231f58 WatchSource:0}: Error finding container 37a7bbb4e5833bc0e9b46191204b7c6fbff24db23aa701a4711336c3c8231f58: Status 404 returned error can't find the container with id 37a7bbb4e5833bc0e9b46191204b7c6fbff24db23aa701a4711336c3c8231f58 Jul 22 17:18:23.536951 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.536921 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 17:18:23.540707 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.540676 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.543163 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.542982 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 22 17:18:23.543286 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.543266 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 22 17:18:23.543468 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.543452 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 22 17:18:23.544520 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.543942 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lhp9k\"" Jul 22 17:18:23.544520 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.544018 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 22 17:18:23.544520 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.544202 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 22 17:18:23.544520 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.544228 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 22 17:18:23.544520 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.544368 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 22 17:18:23.544520 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.544403 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 22 17:18:23.545279 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.545072 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 22 17:18:23.545279 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.545116 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-432fp4lccq1cg\"" Jul 22 17:18:23.545279 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.545146 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 22 17:18:23.545279 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.545154 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 22 17:18:23.545795 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.545753 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 22 17:18:23.548175 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.548154 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 22 17:18:23.551187 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.551166 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 22 17:18:23.560267 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.560171 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 17:18:23.614307 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614267 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38057a39-a16f-481e-a3c9-248817e9766a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.614307 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614313 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.614848 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614334 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.614848 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614356 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.614848 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614380 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.614848 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614405 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.614848 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614423 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.614848 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614440 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.614848 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614577 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.614848 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614624 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.614848 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614677 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.614848 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614714 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-config\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.614848 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614745 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.614848 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614809 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-web-config\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.615295 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614867 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.615295 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614888 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.615295 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614937 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.615295 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.614983 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lj8r\" (UniqueName: \"kubernetes.io/projected/38057a39-a16f-481e-a3c9-248817e9766a-kube-api-access-5lj8r\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.615295 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.615018 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.615295 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.615046 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38057a39-a16f-481e-a3c9-248817e9766a-config-out\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.701727 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.701674 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" event={"ID":"72a999a7-bc35-4e29-9d9b-3a5b51482c17","Type":"ContainerStarted","Data":"4af61300694b86744dd769a506fed8e4fdfb909ed79f1dab0abed5e1d38b44e8"} Jul 22 17:18:23.701926 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.701825 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" event={"ID":"72a999a7-bc35-4e29-9d9b-3a5b51482c17","Type":"ContainerStarted","Data":"fea0d936d19ec688c6fa0309e32e739b9f6455036ca82eaeac45f35bca66b60d"} Jul 22 17:18:23.701926 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.701878 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" event={"ID":"72a999a7-bc35-4e29-9d9b-3a5b51482c17","Type":"ContainerStarted","Data":"1cb18c3325420482466082e86de18a1aab4117f715d17251c3f403945d0ec267"} Jul 22 17:18:23.703118 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.703084 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" event={"ID":"56c6e577-9823-4055-9799-0dbb1a6d2448","Type":"ContainerStarted","Data":"37a7bbb4e5833bc0e9b46191204b7c6fbff24db23aa701a4711336c3c8231f58"} Jul 22 17:18:23.705022 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.704985 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6874db97cb-b2v45" event={"ID":"47d1febd-d2a1-4056-8cec-fc197f47bb88","Type":"ContainerStarted","Data":"87032c8afead0b1973919349f05e2061ee5a4bd815c062c7b79c7c6425e86748"} Jul 22 17:18:23.705131 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.705032 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6874db97cb-b2v45" event={"ID":"47d1febd-d2a1-4056-8cec-fc197f47bb88","Type":"ContainerStarted","Data":"f78ff8e518c91827c477942786dc817f1fbfb7b7933c8d9f478313f0bdf96ea1"} Jul 22 17:18:23.716261 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716230 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.716388 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716267 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.716388 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716290 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.716388 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716336 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.716560 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716456 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.716560 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716503 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.716560 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716540 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-config\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.716711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716656 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.716711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716702 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-web-config\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.716833 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716734 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.716833 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716778 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.716833 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716807 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.716833 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716829 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lj8r\" (UniqueName: \"kubernetes.io/projected/38057a39-a16f-481e-a3c9-248817e9766a-kube-api-access-5lj8r\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.717018 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716856 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.717018 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716885 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38057a39-a16f-481e-a3c9-248817e9766a-config-out\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.717018 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716950 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38057a39-a16f-481e-a3c9-248817e9766a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.717018 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716973 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.717018 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.716981 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.717018 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.717006 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.717307 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.717033 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.717307 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.717060 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.717307 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.717144 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.717930 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.717906 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.720428 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.719607 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.720428 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.720078 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-config\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.720428 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.720244 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.721123 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.721101 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.721341 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.721269 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.721860 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.721699 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-web-config\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.721860 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.721827 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.722636 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.722598 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.722875 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.722600 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.722875 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.722639 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.723136 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.722949 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38057a39-a16f-481e-a3c9-248817e9766a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.723136 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.723076 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.724382 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.724339 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.724824 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.724806 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.724981 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.724949 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.725136 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.725096 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38057a39-a16f-481e-a3c9-248817e9766a-config-out\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.725242 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.725199 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6874db97cb-b2v45" podStartSLOduration=2.72518146 podStartE2EDuration="2.72518146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:18:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:23.721934272 +0000 UTC m=+84.133659914" watchObservedRunningTime="2026-07-22 17:18:23.72518146 +0000 UTC m=+84.136907067" Jul 22 17:18:23.726471 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.726442 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lj8r\" (UniqueName: \"kubernetes.io/projected/38057a39-a16f-481e-a3c9-248817e9766a-kube-api-access-5lj8r\") pod \"prometheus-k8s-0\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:23.853024 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:23.852866 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:24.184879 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:24.184806 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 17:18:24.187095 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:18:24.187056 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38057a39_a16f_481e_a3c9_248817e9766a.slice/crio-03863f2527e4988b9b11f92445e46775dd4de173341c419c9e73268c4351061f WatchSource:0}: Error finding container 03863f2527e4988b9b11f92445e46775dd4de173341c419c9e73268c4351061f: Status 404 returned error can't find the container with id 03863f2527e4988b9b11f92445e46775dd4de173341c419c9e73268c4351061f Jul 22 17:18:24.712153 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:24.712117 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38057a39-a16f-481e-a3c9-248817e9766a","Type":"ContainerStarted","Data":"03863f2527e4988b9b11f92445e46775dd4de173341c419c9e73268c4351061f"} Jul 22 17:18:24.716370 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:24.716143 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" event={"ID":"72a999a7-bc35-4e29-9d9b-3a5b51482c17","Type":"ContainerStarted","Data":"3a4ac853f3b2a00453a4fee3281a4752e838ac0a838b9507702b0592fb774456"} Jul 22 17:18:24.716370 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:24.716233 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:24.716370 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:24.716277 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" event={"ID":"72a999a7-bc35-4e29-9d9b-3a5b51482c17","Type":"ContainerStarted","Data":"e613892e0c51de4b5ba629d756a982cb2716b71316b4f1265745851766ce61f6"} Jul 22 17:18:24.716370 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:24.716319 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" event={"ID":"72a999a7-bc35-4e29-9d9b-3a5b51482c17","Type":"ContainerStarted","Data":"21eda83ea758373540369a6183de54ef40031c64b46a27244d13fe9e8a486d40"} Jul 22 17:18:24.718611 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:24.718569 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" event={"ID":"5af19be2-849c-44a3-9a9e-65b1d009db02","Type":"ContainerStarted","Data":"e392e1efab14869b23324ba5e737012207d0a9c432f09c68dc3f7d5bbb009be6"} Jul 22 17:18:24.778386 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:24.778121 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" podStartSLOduration=1.7520052910000001 podStartE2EDuration="3.77810291s" totalImagesPullingTime="2.026097619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:24.77771408 +0000 UTC m=+85.189439690" watchObservedRunningTime="2026-07-22 17:18:24.77810291 +0000 UTC m=+85.189828520" Jul 22 17:18:24.779617 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:24.779331 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" podStartSLOduration=1.670057249 podStartE2EDuration="4.779319415s" totalImagesPullingTime="3.109262166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:18:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:24.74771334 +0000 UTC m=+85.159438955" watchObservedRunningTime="2026-07-22 17:18:24.779319415 +0000 UTC m=+85.191045025" Jul 22 17:18:26.727390 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:26.727348 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" event={"ID":"56c6e577-9823-4055-9799-0dbb1a6d2448","Type":"ContainerStarted","Data":"9d45f6cb32e05e1391b8419618545ac91ac9a9fb2fa61a76fc787212027fe9a5"} Jul 22 17:18:26.727904 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:26.727417 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" event={"ID":"56c6e577-9823-4055-9799-0dbb1a6d2448","Type":"ContainerStarted","Data":"8863dea05bf99bebc0b6054da95eee59f7d118738eeebe4c4e6abbd8b6cd37ed"} Jul 22 17:18:26.727904 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:26.727447 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" event={"ID":"56c6e577-9823-4055-9799-0dbb1a6d2448","Type":"ContainerStarted","Data":"f65000f2d2a54bf9d61f2297936ba71029a5421c5142ec2f87336d874dea0ae7"} Jul 22 17:18:26.728911 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:26.728887 2566 generic.go:356] "Generic (PLEG): container finished" podID="38057a39-a16f-481e-a3c9-248817e9766a" containerID="5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7" exitCode=0 Jul 22 17:18:26.729009 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:26.728952 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38057a39-a16f-481e-a3c9-248817e9766a","Type":"ContainerDied","Data":"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7"} Jul 22 17:18:26.752027 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:26.751974 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-56895fb4fb-472jd" podStartSLOduration=2.042226796 podStartE2EDuration="4.75195895s" totalImagesPullingTime="2.709732154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:26.750649514 +0000 UTC m=+87.162375126" watchObservedRunningTime="2026-07-22 17:18:26.75195895 +0000 UTC m=+87.163684559" Jul 22 17:18:27.603864 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:27.603750 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6874db97cb-b2v45"] Jul 22 17:18:30.728424 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:30.728402 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7dcbc884dc-dbf59" Jul 22 17:18:30.752388 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:30.750243 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38057a39-a16f-481e-a3c9-248817e9766a","Type":"ContainerStarted","Data":"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb"} Jul 22 17:18:30.752388 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:30.750319 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38057a39-a16f-481e-a3c9-248817e9766a","Type":"ContainerStarted","Data":"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf"} Jul 22 17:18:30.752388 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:30.750357 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38057a39-a16f-481e-a3c9-248817e9766a","Type":"ContainerStarted","Data":"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2"} Jul 22 17:18:30.752388 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:30.750393 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38057a39-a16f-481e-a3c9-248817e9766a","Type":"ContainerStarted","Data":"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637"} Jul 22 17:18:30.752388 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:30.750430 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38057a39-a16f-481e-a3c9-248817e9766a","Type":"ContainerStarted","Data":"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de"} Jul 22 17:18:31.757957 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:31.757919 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38057a39-a16f-481e-a3c9-248817e9766a","Type":"ContainerStarted","Data":"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd"} Jul 22 17:18:31.787393 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:31.787330 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.557383203 podStartE2EDuration="8.787308746s" totalImagesPullingTime="5.208912281s" totalInitContainerRuntime="21.013262ms" isStatefulPod=false podCreationTimestamp="2026-07-22 17:18:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:31.785188069 +0000 UTC m=+92.196913677" watchObservedRunningTime="2026-07-22 17:18:31.787308746 +0000 UTC m=+92.199034356" Jul 22 17:18:32.201501 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:32.201460 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:33.853527 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:33.853485 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:18:38.094949 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:38.094910 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bb7fd8fb7-fhhg2"] Jul 22 17:18:40.764673 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:40.764625 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-777c94b997-gnmwd" podUID="d0719ca9-6f9c-4f31-8f11-5587c907137a" containerName="console" containerID="cri-o://0e10430735063f0d8828b959a2525af065fdc6718b7534f4677b628034c1be1e" gracePeriod=15 Jul 22 17:18:41.536339 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.536305 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:41.686566 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.686470 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-config\") pod \"d0719ca9-6f9c-4f31-8f11-5587c907137a\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " Jul 22 17:18:41.686566 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.686510 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-serving-cert\") pod \"d0719ca9-6f9c-4f31-8f11-5587c907137a\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " Jul 22 17:18:41.686566 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.686543 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-oauth-serving-cert\") pod \"d0719ca9-6f9c-4f31-8f11-5587c907137a\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " Jul 22 17:18:41.686966 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.686578 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-oauth-config\") pod \"d0719ca9-6f9c-4f31-8f11-5587c907137a\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " Jul 22 17:18:41.686966 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.686636 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-service-ca\") pod \"d0719ca9-6f9c-4f31-8f11-5587c907137a\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " Jul 22 17:18:41.686966 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.686754 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2hrx\" (UniqueName: \"kubernetes.io/projected/d0719ca9-6f9c-4f31-8f11-5587c907137a-kube-api-access-j2hrx\") pod \"d0719ca9-6f9c-4f31-8f11-5587c907137a\" (UID: \"d0719ca9-6f9c-4f31-8f11-5587c907137a\") " Jul 22 17:18:41.687109 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.687016 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d0719ca9-6f9c-4f31-8f11-5587c907137a" (UID: "d0719ca9-6f9c-4f31-8f11-5587c907137a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:18:41.687109 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.687023 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-config" (OuterVolumeSpecName: "console-config") pod "d0719ca9-6f9c-4f31-8f11-5587c907137a" (UID: "d0719ca9-6f9c-4f31-8f11-5587c907137a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:18:41.687109 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.687072 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-service-ca" (OuterVolumeSpecName: "service-ca") pod "d0719ca9-6f9c-4f31-8f11-5587c907137a" (UID: "d0719ca9-6f9c-4f31-8f11-5587c907137a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:18:41.688905 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.688866 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d0719ca9-6f9c-4f31-8f11-5587c907137a" (UID: "d0719ca9-6f9c-4f31-8f11-5587c907137a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:18:41.689000 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.688923 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0719ca9-6f9c-4f31-8f11-5587c907137a-kube-api-access-j2hrx" (OuterVolumeSpecName: "kube-api-access-j2hrx") pod "d0719ca9-6f9c-4f31-8f11-5587c907137a" (UID: "d0719ca9-6f9c-4f31-8f11-5587c907137a"). InnerVolumeSpecName "kube-api-access-j2hrx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:18:41.689000 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.688940 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d0719ca9-6f9c-4f31-8f11-5587c907137a" (UID: "d0719ca9-6f9c-4f31-8f11-5587c907137a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:18:41.788458 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.788418 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-oauth-serving-cert\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:18:41.788458 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.788452 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-oauth-config\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:18:41.788458 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.788462 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-service-ca\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:18:41.788971 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.788472 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2hrx\" (UniqueName: \"kubernetes.io/projected/d0719ca9-6f9c-4f31-8f11-5587c907137a-kube-api-access-j2hrx\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:18:41.788971 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.788480 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-config\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:18:41.788971 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.788488 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0719ca9-6f9c-4f31-8f11-5587c907137a-console-serving-cert\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:18:41.796712 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.796683 2566 generic.go:356] "Generic (PLEG): container finished" podID="d0719ca9-6f9c-4f31-8f11-5587c907137a" containerID="0e10430735063f0d8828b959a2525af065fdc6718b7534f4677b628034c1be1e" exitCode=0 Jul 22 17:18:41.796875 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.796730 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777c94b997-gnmwd" Jul 22 17:18:41.796875 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.796797 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777c94b997-gnmwd" event={"ID":"d0719ca9-6f9c-4f31-8f11-5587c907137a","Type":"ContainerDied","Data":"0e10430735063f0d8828b959a2525af065fdc6718b7534f4677b628034c1be1e"} Jul 22 17:18:41.796875 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.796844 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777c94b997-gnmwd" event={"ID":"d0719ca9-6f9c-4f31-8f11-5587c907137a","Type":"ContainerDied","Data":"257484ab7090fbf2e033141fd593781c3049c9035c7f0beafe516d570f986176"} Jul 22 17:18:41.796875 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.796863 2566 scope.go:117] "RemoveContainer" containerID="0e10430735063f0d8828b959a2525af065fdc6718b7534f4677b628034c1be1e" Jul 22 17:18:41.805502 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.805481 2566 scope.go:117] "RemoveContainer" containerID="0e10430735063f0d8828b959a2525af065fdc6718b7534f4677b628034c1be1e" Jul 22 17:18:41.805806 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:18:41.805786 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e10430735063f0d8828b959a2525af065fdc6718b7534f4677b628034c1be1e\": container with ID starting with 0e10430735063f0d8828b959a2525af065fdc6718b7534f4677b628034c1be1e not found: ID does not exist" containerID="0e10430735063f0d8828b959a2525af065fdc6718b7534f4677b628034c1be1e" Jul 22 17:18:41.805856 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.805814 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e10430735063f0d8828b959a2525af065fdc6718b7534f4677b628034c1be1e"} err="failed to get container status \"0e10430735063f0d8828b959a2525af065fdc6718b7534f4677b628034c1be1e\": rpc error: code = NotFound desc = could not find container \"0e10430735063f0d8828b959a2525af065fdc6718b7534f4677b628034c1be1e\": container with ID starting with 0e10430735063f0d8828b959a2525af065fdc6718b7534f4677b628034c1be1e not found: ID does not exist" Jul 22 17:18:41.819533 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.819500 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-777c94b997-gnmwd"] Jul 22 17:18:41.823433 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.823406 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-777c94b997-gnmwd"] Jul 22 17:18:41.847996 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.847963 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:41.848129 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:41.848033 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:18:42.234882 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:42.234846 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0719ca9-6f9c-4f31-8f11-5587c907137a" path="/var/lib/kubelet/pods/d0719ca9-6f9c-4f31-8f11-5587c907137a/volumes" Jul 22 17:18:47.665050 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:47.665016 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xccc6" Jul 22 17:18:52.627520 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.627455 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6874db97cb-b2v45" podUID="47d1febd-d2a1-4056-8cec-fc197f47bb88" containerName="console" containerID="cri-o://87032c8afead0b1973919349f05e2061ee5a4bd815c062c7b79c7c6425e86748" gracePeriod=15 Jul 22 17:18:52.844724 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.844690 2566 generic.go:356] "Generic (PLEG): container finished" podID="47d1febd-d2a1-4056-8cec-fc197f47bb88" containerID="87032c8afead0b1973919349f05e2061ee5a4bd815c062c7b79c7c6425e86748" exitCode=0 Jul 22 17:18:52.844938 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.844770 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6874db97cb-b2v45" event={"ID":"47d1febd-d2a1-4056-8cec-fc197f47bb88","Type":"ContainerDied","Data":"87032c8afead0b1973919349f05e2061ee5a4bd815c062c7b79c7c6425e86748"} Jul 22 17:18:52.875509 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.875485 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:52.977529 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.977443 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-oauth-serving-cert\") pod \"47d1febd-d2a1-4056-8cec-fc197f47bb88\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " Jul 22 17:18:52.977529 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.977477 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-trusted-ca-bundle\") pod \"47d1febd-d2a1-4056-8cec-fc197f47bb88\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " Jul 22 17:18:52.977529 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.977503 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfvc9\" (UniqueName: \"kubernetes.io/projected/47d1febd-d2a1-4056-8cec-fc197f47bb88-kube-api-access-gfvc9\") pod \"47d1febd-d2a1-4056-8cec-fc197f47bb88\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " Jul 22 17:18:52.977836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.977536 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-serving-cert\") pod \"47d1febd-d2a1-4056-8cec-fc197f47bb88\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " Jul 22 17:18:52.977836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.977571 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-oauth-config\") pod \"47d1febd-d2a1-4056-8cec-fc197f47bb88\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " Jul 22 17:18:52.977836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.977594 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-config\") pod \"47d1febd-d2a1-4056-8cec-fc197f47bb88\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " Jul 22 17:18:52.977836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.977609 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-service-ca\") pod \"47d1febd-d2a1-4056-8cec-fc197f47bb88\" (UID: \"47d1febd-d2a1-4056-8cec-fc197f47bb88\") " Jul 22 17:18:52.978041 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.977967 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "47d1febd-d2a1-4056-8cec-fc197f47bb88" (UID: "47d1febd-d2a1-4056-8cec-fc197f47bb88"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:18:52.978087 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.978046 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-config" (OuterVolumeSpecName: "console-config") pod "47d1febd-d2a1-4056-8cec-fc197f47bb88" (UID: "47d1febd-d2a1-4056-8cec-fc197f47bb88"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:18:52.978262 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.978231 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "47d1febd-d2a1-4056-8cec-fc197f47bb88" (UID: "47d1febd-d2a1-4056-8cec-fc197f47bb88"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:18:52.978321 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.978256 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-service-ca" (OuterVolumeSpecName: "service-ca") pod "47d1febd-d2a1-4056-8cec-fc197f47bb88" (UID: "47d1febd-d2a1-4056-8cec-fc197f47bb88"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:18:52.979832 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.979729 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "47d1febd-d2a1-4056-8cec-fc197f47bb88" (UID: "47d1febd-d2a1-4056-8cec-fc197f47bb88"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:18:52.979832 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.979784 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47d1febd-d2a1-4056-8cec-fc197f47bb88-kube-api-access-gfvc9" (OuterVolumeSpecName: "kube-api-access-gfvc9") pod "47d1febd-d2a1-4056-8cec-fc197f47bb88" (UID: "47d1febd-d2a1-4056-8cec-fc197f47bb88"). InnerVolumeSpecName "kube-api-access-gfvc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:18:52.980423 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:52.980389 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "47d1febd-d2a1-4056-8cec-fc197f47bb88" (UID: "47d1febd-d2a1-4056-8cec-fc197f47bb88"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:18:53.079221 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:53.079186 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-service-ca\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:18:53.079221 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:53.079213 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-oauth-serving-cert\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:18:53.079221 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:53.079228 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-trusted-ca-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:18:53.079452 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:53.079242 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfvc9\" (UniqueName: \"kubernetes.io/projected/47d1febd-d2a1-4056-8cec-fc197f47bb88-kube-api-access-gfvc9\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:18:53.079452 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:53.079254 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-serving-cert\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:18:53.079452 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:53.079263 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-oauth-config\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:18:53.079452 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:53.079272 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47d1febd-d2a1-4056-8cec-fc197f47bb88-console-config\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:18:53.849349 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:53.849304 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6874db97cb-b2v45" event={"ID":"47d1febd-d2a1-4056-8cec-fc197f47bb88","Type":"ContainerDied","Data":"f78ff8e518c91827c477942786dc817f1fbfb7b7933c8d9f478313f0bdf96ea1"} Jul 22 17:18:53.849349 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:53.849343 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6874db97cb-b2v45" Jul 22 17:18:53.849886 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:53.849411 2566 scope.go:117] "RemoveContainer" containerID="87032c8afead0b1973919349f05e2061ee5a4bd815c062c7b79c7c6425e86748" Jul 22 17:18:53.870046 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:53.870015 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6874db97cb-b2v45"] Jul 22 17:18:53.874184 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:53.874158 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6874db97cb-b2v45"] Jul 22 17:18:54.235210 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:18:54.235127 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47d1febd-d2a1-4056-8cec-fc197f47bb88" path="/var/lib/kubelet/pods/47d1febd-d2a1-4056-8cec-fc197f47bb88/volumes" Jul 22 17:19:01.853873 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:01.853843 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:19:01.858179 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:01.858154 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7944974dc6-n7d5m" Jul 22 17:19:03.121257 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.121199 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bb7fd8fb7-fhhg2" podUID="a20d0bd9-797b-4c50-9a55-7e9aea3b4461" containerName="console" containerID="cri-o://d9d5a0330a8b33c22a0bbc6a7a6ddde83e302836d35db03ec8f9cc30ce0d0efb" gracePeriod=15 Jul 22 17:19:03.367111 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.367089 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:19:03.463644 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.463552 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-oauth-serving-cert\") pod \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " Jul 22 17:19:03.463644 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.463614 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-config\") pod \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " Jul 22 17:19:03.463644 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.463640 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-oauth-config\") pod \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " Jul 22 17:19:03.463958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.463677 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkpck\" (UniqueName: \"kubernetes.io/projected/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-kube-api-access-qkpck\") pod \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " Jul 22 17:19:03.463958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.463699 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-service-ca\") pod \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " Jul 22 17:19:03.463958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.463743 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-trusted-ca-bundle\") pod \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " Jul 22 17:19:03.463958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.463797 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-serving-cert\") pod \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\" (UID: \"a20d0bd9-797b-4c50-9a55-7e9aea3b4461\") " Jul 22 17:19:03.463958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.463906 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a20d0bd9-797b-4c50-9a55-7e9aea3b4461" (UID: "a20d0bd9-797b-4c50-9a55-7e9aea3b4461"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:19:03.464215 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.464103 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-config" (OuterVolumeSpecName: "console-config") pod "a20d0bd9-797b-4c50-9a55-7e9aea3b4461" (UID: "a20d0bd9-797b-4c50-9a55-7e9aea3b4461"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:19:03.464267 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.464217 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a20d0bd9-797b-4c50-9a55-7e9aea3b4461" (UID: "a20d0bd9-797b-4c50-9a55-7e9aea3b4461"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:19:03.464418 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.464391 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-service-ca" (OuterVolumeSpecName: "service-ca") pod "a20d0bd9-797b-4c50-9a55-7e9aea3b4461" (UID: "a20d0bd9-797b-4c50-9a55-7e9aea3b4461"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:19:03.466012 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.465994 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a20d0bd9-797b-4c50-9a55-7e9aea3b4461" (UID: "a20d0bd9-797b-4c50-9a55-7e9aea3b4461"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:03.466350 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.466330 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-kube-api-access-qkpck" (OuterVolumeSpecName: "kube-api-access-qkpck") pod "a20d0bd9-797b-4c50-9a55-7e9aea3b4461" (UID: "a20d0bd9-797b-4c50-9a55-7e9aea3b4461"). InnerVolumeSpecName "kube-api-access-qkpck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:19:03.466400 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.466353 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a20d0bd9-797b-4c50-9a55-7e9aea3b4461" (UID: "a20d0bd9-797b-4c50-9a55-7e9aea3b4461"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:03.565027 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.564980 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-oauth-serving-cert\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:03.565027 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.565018 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-config\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:03.565027 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.565027 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-oauth-config\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:03.565027 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.565036 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkpck\" (UniqueName: \"kubernetes.io/projected/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-kube-api-access-qkpck\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:03.565295 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.565045 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-service-ca\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:03.565295 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.565053 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-trusted-ca-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:03.565295 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.565062 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a20d0bd9-797b-4c50-9a55-7e9aea3b4461-console-serving-cert\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:03.887958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.887921 2566 generic.go:356] "Generic (PLEG): container finished" podID="a20d0bd9-797b-4c50-9a55-7e9aea3b4461" containerID="d9d5a0330a8b33c22a0bbc6a7a6ddde83e302836d35db03ec8f9cc30ce0d0efb" exitCode=0 Jul 22 17:19:03.888130 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.887972 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb7fd8fb7-fhhg2" Jul 22 17:19:03.888130 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.887975 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb7fd8fb7-fhhg2" event={"ID":"a20d0bd9-797b-4c50-9a55-7e9aea3b4461","Type":"ContainerDied","Data":"d9d5a0330a8b33c22a0bbc6a7a6ddde83e302836d35db03ec8f9cc30ce0d0efb"} Jul 22 17:19:03.888130 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.888079 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb7fd8fb7-fhhg2" event={"ID":"a20d0bd9-797b-4c50-9a55-7e9aea3b4461","Type":"ContainerDied","Data":"8f447929a9ea20447a990468fc714c23f80e3281fa3e419bd70af0555f3e4649"} Jul 22 17:19:03.888130 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.888101 2566 scope.go:117] "RemoveContainer" containerID="d9d5a0330a8b33c22a0bbc6a7a6ddde83e302836d35db03ec8f9cc30ce0d0efb" Jul 22 17:19:03.898575 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.898551 2566 scope.go:117] "RemoveContainer" containerID="d9d5a0330a8b33c22a0bbc6a7a6ddde83e302836d35db03ec8f9cc30ce0d0efb" Jul 22 17:19:03.899121 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:19:03.899094 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9d5a0330a8b33c22a0bbc6a7a6ddde83e302836d35db03ec8f9cc30ce0d0efb\": container with ID starting with d9d5a0330a8b33c22a0bbc6a7a6ddde83e302836d35db03ec8f9cc30ce0d0efb not found: ID does not exist" containerID="d9d5a0330a8b33c22a0bbc6a7a6ddde83e302836d35db03ec8f9cc30ce0d0efb" Jul 22 17:19:03.899300 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.899133 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9d5a0330a8b33c22a0bbc6a7a6ddde83e302836d35db03ec8f9cc30ce0d0efb"} err="failed to get container status \"d9d5a0330a8b33c22a0bbc6a7a6ddde83e302836d35db03ec8f9cc30ce0d0efb\": rpc error: code = NotFound desc = could not find container \"d9d5a0330a8b33c22a0bbc6a7a6ddde83e302836d35db03ec8f9cc30ce0d0efb\": container with ID starting with d9d5a0330a8b33c22a0bbc6a7a6ddde83e302836d35db03ec8f9cc30ce0d0efb not found: ID does not exist" Jul 22 17:19:03.910514 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.910487 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bb7fd8fb7-fhhg2"] Jul 22 17:19:03.914158 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:03.914127 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bb7fd8fb7-fhhg2"] Jul 22 17:19:04.234484 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:04.234401 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a20d0bd9-797b-4c50-9a55-7e9aea3b4461" path="/var/lib/kubelet/pods/a20d0bd9-797b-4c50-9a55-7e9aea3b4461/volumes" Jul 22 17:19:23.854035 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:23.853990 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:23.873150 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:23.873122 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:23.980168 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:23.980142 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:41.968805 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:41.968749 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 17:19:41.969308 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:41.969135 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="prometheus" containerID="cri-o://67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de" gracePeriod=600 Jul 22 17:19:41.969308 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:41.969223 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="kube-rbac-proxy" containerID="cri-o://2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb" gracePeriod=600 Jul 22 17:19:41.969435 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:41.969274 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="kube-rbac-proxy-web" containerID="cri-o://97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf" gracePeriod=600 Jul 22 17:19:41.969435 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:41.969166 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd" gracePeriod=600 Jul 22 17:19:41.969561 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:41.969426 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="config-reloader" containerID="cri-o://407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637" gracePeriod=600 Jul 22 17:19:41.969561 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:41.969289 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="thanos-sidecar" containerID="cri-o://5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2" gracePeriod=600 Jul 22 17:19:42.225338 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.225274 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:42.287895 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.287861 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-0\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.288063 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.287907 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.288063 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.287930 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-tls\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.288063 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.287954 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-web-config\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.288063 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.287974 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-kubelet-serving-ca-bundle\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.288063 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.287998 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-db\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.288063 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.288048 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-kube-rbac-proxy\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.288372 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.288076 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lj8r\" (UniqueName: \"kubernetes.io/projected/38057a39-a16f-481e-a3c9-248817e9766a-kube-api-access-5lj8r\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.288372 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.288107 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-metrics-client-certs\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.288372 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.288131 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-trusted-ca-bundle\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.288372 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.288161 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-thanos-prometheus-http-client-file\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.288372 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.288215 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-serving-certs-ca-bundle\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.288620 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.288545 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:19:42.289657 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.289192 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:19:42.289657 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.289471 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:19:42.289927 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.289686 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:19:42.290776 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.290713 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:19:42.291001 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.290975 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:42.291387 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.291358 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38057a39-a16f-481e-a3c9-248817e9766a-kube-api-access-5lj8r" (OuterVolumeSpecName: "kube-api-access-5lj8r") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "kube-api-access-5lj8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:19:42.291756 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.291731 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:42.291970 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.291950 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:42.292177 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.292155 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:42.292333 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.292318 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:42.301240 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.301209 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-web-config" (OuterVolumeSpecName: "web-config") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:42.389633 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.389584 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.389847 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.389698 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-2\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.389847 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.389724 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38057a39-a16f-481e-a3c9-248817e9766a-config-out\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.389847 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.389739 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-config\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.389847 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.389786 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-1\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.389847 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.389810 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-metrics-client-ca\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.389847 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.389835 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-grpc-tls\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.390155 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.389858 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38057a39-a16f-481e-a3c9-248817e9766a-tls-assets\") pod \"38057a39-a16f-481e-a3c9-248817e9766a\" (UID: \"38057a39-a16f-481e-a3c9-248817e9766a\") " Jul 22 17:19:42.390155 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.390038 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.390155 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.390054 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-db\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.390155 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.390067 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-kube-rbac-proxy\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.390155 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.390080 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lj8r\" (UniqueName: \"kubernetes.io/projected/38057a39-a16f-481e-a3c9-248817e9766a-kube-api-access-5lj8r\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.390155 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.390095 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-metrics-client-certs\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.390155 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.390109 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.390155 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.390123 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.390155 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.390136 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.390155 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.390150 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.390628 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.390162 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.390628 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.390175 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.390628 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.390191 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-web-config\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.390628 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.390214 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:19:42.390628 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.390320 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:19:42.390628 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.390444 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:19:42.393346 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.393313 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-config" (OuterVolumeSpecName: "config") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:42.393583 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.393539 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:42.393922 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.393892 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:42.394006 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.393899 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38057a39-a16f-481e-a3c9-248817e9766a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:19:42.396572 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.396549 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38057a39-a16f-481e-a3c9-248817e9766a-config-out" (OuterVolumeSpecName: "config-out") pod "38057a39-a16f-481e-a3c9-248817e9766a" (UID: "38057a39-a16f-481e-a3c9-248817e9766a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:19:42.490694 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.490602 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.490694 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.490635 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38057a39-a16f-481e-a3c9-248817e9766a-config-out\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.490694 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.490646 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-config\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.490694 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.490654 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.490694 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.490671 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38057a39-a16f-481e-a3c9-248817e9766a-configmap-metrics-client-ca\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.490694 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.490681 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-grpc-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.490694 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.490689 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38057a39-a16f-481e-a3c9-248817e9766a-tls-assets\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:42.490694 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:42.490700 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38057a39-a16f-481e-a3c9-248817e9766a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:19:43.035011 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.034971 2566 generic.go:356] "Generic (PLEG): container finished" podID="38057a39-a16f-481e-a3c9-248817e9766a" containerID="0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd" exitCode=0 Jul 22 17:19:43.035011 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.035007 2566 generic.go:356] "Generic (PLEG): container finished" podID="38057a39-a16f-481e-a3c9-248817e9766a" containerID="2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb" exitCode=0 Jul 22 17:19:43.035011 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.035019 2566 generic.go:356] "Generic (PLEG): container finished" podID="38057a39-a16f-481e-a3c9-248817e9766a" containerID="97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf" exitCode=0 Jul 22 17:19:43.035479 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.035028 2566 generic.go:356] "Generic (PLEG): container finished" podID="38057a39-a16f-481e-a3c9-248817e9766a" containerID="5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2" exitCode=0 Jul 22 17:19:43.035479 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.035036 2566 generic.go:356] "Generic (PLEG): container finished" podID="38057a39-a16f-481e-a3c9-248817e9766a" containerID="407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637" exitCode=0 Jul 22 17:19:43.035479 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.035044 2566 generic.go:356] "Generic (PLEG): container finished" podID="38057a39-a16f-481e-a3c9-248817e9766a" containerID="67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de" exitCode=0 Jul 22 17:19:43.035479 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.035078 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.035479 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.035030 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38057a39-a16f-481e-a3c9-248817e9766a","Type":"ContainerDied","Data":"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd"} Jul 22 17:19:43.035479 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.035190 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38057a39-a16f-481e-a3c9-248817e9766a","Type":"ContainerDied","Data":"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb"} Jul 22 17:19:43.035479 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.035217 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38057a39-a16f-481e-a3c9-248817e9766a","Type":"ContainerDied","Data":"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf"} Jul 22 17:19:43.035479 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.035242 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38057a39-a16f-481e-a3c9-248817e9766a","Type":"ContainerDied","Data":"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2"} Jul 22 17:19:43.035479 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.035260 2566 scope.go:117] "RemoveContainer" containerID="0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd" Jul 22 17:19:43.035479 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.035266 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38057a39-a16f-481e-a3c9-248817e9766a","Type":"ContainerDied","Data":"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637"} Jul 22 17:19:43.035479 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.035365 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38057a39-a16f-481e-a3c9-248817e9766a","Type":"ContainerDied","Data":"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de"} Jul 22 17:19:43.035479 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.035406 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38057a39-a16f-481e-a3c9-248817e9766a","Type":"ContainerDied","Data":"03863f2527e4988b9b11f92445e46775dd4de173341c419c9e73268c4351061f"} Jul 22 17:19:43.043899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.043882 2566 scope.go:117] "RemoveContainer" containerID="2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb" Jul 22 17:19:43.050778 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.050745 2566 scope.go:117] "RemoveContainer" containerID="97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf" Jul 22 17:19:43.057969 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.057950 2566 scope.go:117] "RemoveContainer" containerID="5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2" Jul 22 17:19:43.059181 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.059074 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 17:19:43.063910 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.063887 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 17:19:43.065923 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.065908 2566 scope.go:117] "RemoveContainer" containerID="407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637" Jul 22 17:19:43.072570 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.072554 2566 scope.go:117] "RemoveContainer" containerID="67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de" Jul 22 17:19:43.079485 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.079467 2566 scope.go:117] "RemoveContainer" containerID="5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7" Jul 22 17:19:43.086171 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.086149 2566 scope.go:117] "RemoveContainer" containerID="0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd" Jul 22 17:19:43.086445 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:19:43.086425 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd\": container with ID starting with 0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd not found: ID does not exist" containerID="0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd" Jul 22 17:19:43.086503 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.086453 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd"} err="failed to get container status \"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd\": rpc error: code = NotFound desc = could not find container \"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd\": container with ID starting with 0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd not found: ID does not exist" Jul 22 17:19:43.086503 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.086472 2566 scope.go:117] "RemoveContainer" containerID="2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb" Jul 22 17:19:43.086706 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:19:43.086690 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb\": container with ID starting with 2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb not found: ID does not exist" containerID="2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb" Jul 22 17:19:43.086744 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.086712 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb"} err="failed to get container status \"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb\": rpc error: code = NotFound desc = could not find container \"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb\": container with ID starting with 2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb not found: ID does not exist" Jul 22 17:19:43.086744 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.086726 2566 scope.go:117] "RemoveContainer" containerID="97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf" Jul 22 17:19:43.086939 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:19:43.086925 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf\": container with ID starting with 97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf not found: ID does not exist" containerID="97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf" Jul 22 17:19:43.086979 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.086943 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf"} err="failed to get container status \"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf\": rpc error: code = NotFound desc = could not find container \"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf\": container with ID starting with 97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf not found: ID does not exist" Jul 22 17:19:43.086979 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.086956 2566 scope.go:117] "RemoveContainer" containerID="5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2" Jul 22 17:19:43.087164 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:19:43.087148 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2\": container with ID starting with 5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2 not found: ID does not exist" containerID="5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2" Jul 22 17:19:43.087206 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.087167 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2"} err="failed to get container status \"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2\": rpc error: code = NotFound desc = could not find container \"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2\": container with ID starting with 5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2 not found: ID does not exist" Jul 22 17:19:43.087206 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.087183 2566 scope.go:117] "RemoveContainer" containerID="407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637" Jul 22 17:19:43.087362 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:19:43.087346 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637\": container with ID starting with 407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637 not found: ID does not exist" containerID="407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637" Jul 22 17:19:43.087401 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.087365 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637"} err="failed to get container status \"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637\": rpc error: code = NotFound desc = could not find container \"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637\": container with ID starting with 407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637 not found: ID does not exist" Jul 22 17:19:43.087401 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.087376 2566 scope.go:117] "RemoveContainer" containerID="67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de" Jul 22 17:19:43.087571 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:19:43.087552 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de\": container with ID starting with 67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de not found: ID does not exist" containerID="67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de" Jul 22 17:19:43.087635 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.087580 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de"} err="failed to get container status \"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de\": rpc error: code = NotFound desc = could not find container \"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de\": container with ID starting with 67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de not found: ID does not exist" Jul 22 17:19:43.087635 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.087603 2566 scope.go:117] "RemoveContainer" containerID="5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7" Jul 22 17:19:43.087826 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:19:43.087808 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7\": container with ID starting with 5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7 not found: ID does not exist" containerID="5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7" Jul 22 17:19:43.087917 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.087826 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7"} err="failed to get container status \"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7\": rpc error: code = NotFound desc = could not find container \"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7\": container with ID starting with 5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7 not found: ID does not exist" Jul 22 17:19:43.087917 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.087838 2566 scope.go:117] "RemoveContainer" containerID="0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd" Jul 22 17:19:43.088067 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.088052 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd"} err="failed to get container status \"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd\": rpc error: code = NotFound desc = could not find container \"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd\": container with ID starting with 0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd not found: ID does not exist" Jul 22 17:19:43.088106 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.088067 2566 scope.go:117] "RemoveContainer" containerID="2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb" Jul 22 17:19:43.088259 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.088242 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb"} err="failed to get container status \"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb\": rpc error: code = NotFound desc = could not find container \"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb\": container with ID starting with 2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb not found: ID does not exist" Jul 22 17:19:43.088308 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.088260 2566 scope.go:117] "RemoveContainer" containerID="97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf" Jul 22 17:19:43.088445 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.088430 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf"} err="failed to get container status \"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf\": rpc error: code = NotFound desc = could not find container \"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf\": container with ID starting with 97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf not found: ID does not exist" Jul 22 17:19:43.088495 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.088444 2566 scope.go:117] "RemoveContainer" containerID="5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2" Jul 22 17:19:43.088625 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.088610 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2"} err="failed to get container status \"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2\": rpc error: code = NotFound desc = could not find container \"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2\": container with ID starting with 5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2 not found: ID does not exist" Jul 22 17:19:43.088670 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.088625 2566 scope.go:117] "RemoveContainer" containerID="407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637" Jul 22 17:19:43.088849 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.088832 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637"} err="failed to get container status \"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637\": rpc error: code = NotFound desc = could not find container \"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637\": container with ID starting with 407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637 not found: ID does not exist" Jul 22 17:19:43.088897 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.088849 2566 scope.go:117] "RemoveContainer" containerID="67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de" Jul 22 17:19:43.089072 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.089051 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de"} err="failed to get container status \"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de\": rpc error: code = NotFound desc = could not find container \"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de\": container with ID starting with 67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de not found: ID does not exist" Jul 22 17:19:43.089126 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.089071 2566 scope.go:117] "RemoveContainer" containerID="5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7" Jul 22 17:19:43.089296 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.089276 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7"} err="failed to get container status \"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7\": rpc error: code = NotFound desc = could not find container \"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7\": container with ID starting with 5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7 not found: ID does not exist" Jul 22 17:19:43.089339 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.089299 2566 scope.go:117] "RemoveContainer" containerID="0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd" Jul 22 17:19:43.089507 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.089488 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd"} err="failed to get container status \"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd\": rpc error: code = NotFound desc = could not find container \"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd\": container with ID starting with 0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd not found: ID does not exist" Jul 22 17:19:43.089572 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.089508 2566 scope.go:117] "RemoveContainer" containerID="2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb" Jul 22 17:19:43.089776 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.089750 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb"} err="failed to get container status \"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb\": rpc error: code = NotFound desc = could not find container \"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb\": container with ID starting with 2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb not found: ID does not exist" Jul 22 17:19:43.089837 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.089777 2566 scope.go:117] "RemoveContainer" containerID="97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf" Jul 22 17:19:43.090009 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.089991 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf"} err="failed to get container status \"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf\": rpc error: code = NotFound desc = could not find container \"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf\": container with ID starting with 97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf not found: ID does not exist" Jul 22 17:19:43.090056 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.090010 2566 scope.go:117] "RemoveContainer" containerID="5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2" Jul 22 17:19:43.090194 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.090169 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2"} err="failed to get container status \"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2\": rpc error: code = NotFound desc = could not find container \"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2\": container with ID starting with 5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2 not found: ID does not exist" Jul 22 17:19:43.090194 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.090194 2566 scope.go:117] "RemoveContainer" containerID="407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637" Jul 22 17:19:43.090418 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.090397 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637"} err="failed to get container status \"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637\": rpc error: code = NotFound desc = could not find container \"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637\": container with ID starting with 407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637 not found: ID does not exist" Jul 22 17:19:43.090459 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.090419 2566 scope.go:117] "RemoveContainer" containerID="67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de" Jul 22 17:19:43.090637 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.090619 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de"} err="failed to get container status \"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de\": rpc error: code = NotFound desc = could not find container \"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de\": container with ID starting with 67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de not found: ID does not exist" Jul 22 17:19:43.090691 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.090637 2566 scope.go:117] "RemoveContainer" containerID="5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7" Jul 22 17:19:43.090882 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.090862 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7"} err="failed to get container status \"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7\": rpc error: code = NotFound desc = could not find container \"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7\": container with ID starting with 5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7 not found: ID does not exist" Jul 22 17:19:43.090927 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.090883 2566 scope.go:117] "RemoveContainer" containerID="0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd" Jul 22 17:19:43.091100 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.091080 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd"} err="failed to get container status \"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd\": rpc error: code = NotFound desc = could not find container \"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd\": container with ID starting with 0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd not found: ID does not exist" Jul 22 17:19:43.091178 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.091100 2566 scope.go:117] "RemoveContainer" containerID="2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb" Jul 22 17:19:43.091449 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.091426 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb"} err="failed to get container status \"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb\": rpc error: code = NotFound desc = could not find container \"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb\": container with ID starting with 2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb not found: ID does not exist" Jul 22 17:19:43.091531 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.091453 2566 scope.go:117] "RemoveContainer" containerID="97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf" Jul 22 17:19:43.091796 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.091754 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf"} err="failed to get container status \"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf\": rpc error: code = NotFound desc = could not find container \"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf\": container with ID starting with 97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf not found: ID does not exist" Jul 22 17:19:43.091796 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.091795 2566 scope.go:117] "RemoveContainer" containerID="5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2" Jul 22 17:19:43.092054 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.092017 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2"} err="failed to get container status \"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2\": rpc error: code = NotFound desc = could not find container \"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2\": container with ID starting with 5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2 not found: ID does not exist" Jul 22 17:19:43.092136 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.092055 2566 scope.go:117] "RemoveContainer" containerID="407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637" Jul 22 17:19:43.092416 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.092393 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637"} err="failed to get container status \"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637\": rpc error: code = NotFound desc = could not find container \"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637\": container with ID starting with 407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637 not found: ID does not exist" Jul 22 17:19:43.092491 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.092416 2566 scope.go:117] "RemoveContainer" containerID="67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de" Jul 22 17:19:43.092677 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.092653 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de"} err="failed to get container status \"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de\": rpc error: code = NotFound desc = could not find container \"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de\": container with ID starting with 67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de not found: ID does not exist" Jul 22 17:19:43.092677 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.092676 2566 scope.go:117] "RemoveContainer" containerID="5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7" Jul 22 17:19:43.093003 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.092982 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7"} err="failed to get container status \"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7\": rpc error: code = NotFound desc = could not find container \"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7\": container with ID starting with 5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7 not found: ID does not exist" Jul 22 17:19:43.093087 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093003 2566 scope.go:117] "RemoveContainer" containerID="0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd" Jul 22 17:19:43.093138 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093094 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 17:19:43.093283 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093259 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd"} err="failed to get container status \"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd\": rpc error: code = NotFound desc = could not find container \"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd\": container with ID starting with 0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd not found: ID does not exist" Jul 22 17:19:43.093341 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093283 2566 scope.go:117] "RemoveContainer" containerID="2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb" Jul 22 17:19:43.093383 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093365 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="thanos-sidecar" Jul 22 17:19:43.093383 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093377 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="thanos-sidecar" Jul 22 17:19:43.093463 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093387 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="kube-rbac-proxy-thanos" Jul 22 17:19:43.093463 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093395 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="kube-rbac-proxy-thanos" Jul 22 17:19:43.093463 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093418 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="kube-rbac-proxy-web" Jul 22 17:19:43.093463 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093427 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="kube-rbac-proxy-web" Jul 22 17:19:43.093463 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093435 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="init-config-reloader" Jul 22 17:19:43.093463 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093441 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="init-config-reloader" Jul 22 17:19:43.093463 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093447 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0719ca9-6f9c-4f31-8f11-5587c907137a" containerName="console" Jul 22 17:19:43.093463 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093452 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0719ca9-6f9c-4f31-8f11-5587c907137a" containerName="console" Jul 22 17:19:43.093463 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093461 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47d1febd-d2a1-4056-8cec-fc197f47bb88" containerName="console" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093469 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="47d1febd-d2a1-4056-8cec-fc197f47bb88" containerName="console" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093477 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="prometheus" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093486 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="prometheus" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093495 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="kube-rbac-proxy" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093499 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="kube-rbac-proxy" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093494 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb"} err="failed to get container status \"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb\": rpc error: code = NotFound desc = could not find container \"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb\": container with ID starting with 2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb not found: ID does not exist" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093525 2566 scope.go:117] "RemoveContainer" containerID="97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093506 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="config-reloader" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093586 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="config-reloader" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093599 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a20d0bd9-797b-4c50-9a55-7e9aea3b4461" containerName="console" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093608 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a20d0bd9-797b-4c50-9a55-7e9aea3b4461" containerName="console" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093692 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="config-reloader" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093707 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="prometheus" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093716 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="kube-rbac-proxy-web" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093724 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="kube-rbac-proxy" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093723 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf"} err="failed to get container status \"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf\": rpc error: code = NotFound desc = could not find container \"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf\": container with ID starting with 97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf not found: ID does not exist" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093739 2566 scope.go:117] "RemoveContainer" containerID="5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093732 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="kube-rbac-proxy-thanos" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093798 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a20d0bd9-797b-4c50-9a55-7e9aea3b4461" containerName="console" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093807 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="47d1febd-d2a1-4056-8cec-fc197f47bb88" containerName="console" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093817 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="38057a39-a16f-481e-a3c9-248817e9766a" containerName="thanos-sidecar" Jul 22 17:19:43.093883 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093826 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0719ca9-6f9c-4f31-8f11-5587c907137a" containerName="console" Jul 22 17:19:43.094937 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093927 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2"} err="failed to get container status \"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2\": rpc error: code = NotFound desc = could not find container \"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2\": container with ID starting with 5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2 not found: ID does not exist" Jul 22 17:19:43.094937 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.093941 2566 scope.go:117] "RemoveContainer" containerID="407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637" Jul 22 17:19:43.094937 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.094125 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637"} err="failed to get container status \"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637\": rpc error: code = NotFound desc = could not find container \"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637\": container with ID starting with 407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637 not found: ID does not exist" Jul 22 17:19:43.094937 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.094139 2566 scope.go:117] "RemoveContainer" containerID="67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de" Jul 22 17:19:43.094937 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.094355 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de"} err="failed to get container status \"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de\": rpc error: code = NotFound desc = could not find container \"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de\": container with ID starting with 67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de not found: ID does not exist" Jul 22 17:19:43.094937 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.094373 2566 scope.go:117] "RemoveContainer" containerID="5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7" Jul 22 17:19:43.094937 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.094559 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7"} err="failed to get container status \"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7\": rpc error: code = NotFound desc = could not find container \"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7\": container with ID starting with 5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7 not found: ID does not exist" Jul 22 17:19:43.094937 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.094573 2566 scope.go:117] "RemoveContainer" containerID="0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd" Jul 22 17:19:43.094937 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.094745 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd"} err="failed to get container status \"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd\": rpc error: code = NotFound desc = could not find container \"0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd\": container with ID starting with 0ef1faf1ce0e8744b0b937dc42e82c95b1830fc5e85c9ebca54ed23b2f252ebd not found: ID does not exist" Jul 22 17:19:43.094937 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.094777 2566 scope.go:117] "RemoveContainer" containerID="2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb" Jul 22 17:19:43.095393 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.094982 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb"} err="failed to get container status \"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb\": rpc error: code = NotFound desc = could not find container \"2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb\": container with ID starting with 2cd9f3ee1e5ad4be755a70bc9de7224c4c180fa38bb63e9f003b12bf68c7d1cb not found: ID does not exist" Jul 22 17:19:43.095393 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.094996 2566 scope.go:117] "RemoveContainer" containerID="97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf" Jul 22 17:19:43.095393 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.095218 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf"} err="failed to get container status \"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf\": rpc error: code = NotFound desc = could not find container \"97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf\": container with ID starting with 97ec250e0360a78bb5c55eaa1588a84b7c44ab435938fb68908b77be9c4eefaf not found: ID does not exist" Jul 22 17:19:43.095393 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.095233 2566 scope.go:117] "RemoveContainer" containerID="5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2" Jul 22 17:19:43.095513 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.095405 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2"} err="failed to get container status \"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2\": rpc error: code = NotFound desc = could not find container \"5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2\": container with ID starting with 5b0d4c53d3000fdda33462b617ccd6d3a27eef3c978e9d481516fc6a227e14b2 not found: ID does not exist" Jul 22 17:19:43.095513 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.095417 2566 scope.go:117] "RemoveContainer" containerID="407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637" Jul 22 17:19:43.095615 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.095598 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637"} err="failed to get container status \"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637\": rpc error: code = NotFound desc = could not find container \"407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637\": container with ID starting with 407591a0858b717e204dba1e5a84eaec48b8309f901f4ff3ba87271b0ec0e637 not found: ID does not exist" Jul 22 17:19:43.095615 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.095613 2566 scope.go:117] "RemoveContainer" containerID="67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de" Jul 22 17:19:43.095808 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.095793 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de"} err="failed to get container status \"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de\": rpc error: code = NotFound desc = could not find container \"67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de\": container with ID starting with 67f18f1a2cd8e6e228fc30f7d752cc5a5223cd66da844cbcf7b6d4a673a636de not found: ID does not exist" Jul 22 17:19:43.095850 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.095808 2566 scope.go:117] "RemoveContainer" containerID="5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7" Jul 22 17:19:43.096003 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.095982 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7"} err="failed to get container status \"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7\": rpc error: code = NotFound desc = could not find container \"5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7\": container with ID starting with 5d132c914cecdc631f5b1f9f95fb21a80136fb39d9e2dd80842399162681bee7 not found: ID does not exist" Jul 22 17:19:43.099590 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.099573 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.102080 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.102058 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 22 17:19:43.102080 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.102071 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 22 17:19:43.102202 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.102074 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lhp9k\"" Jul 22 17:19:43.102202 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.102074 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 22 17:19:43.102202 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.102069 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 22 17:19:43.102336 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.102317 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 22 17:19:43.102423 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.102350 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 22 17:19:43.102582 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.102569 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 22 17:19:43.102644 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.102608 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 22 17:19:43.102644 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.102627 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 22 17:19:43.102927 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.102646 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 22 17:19:43.102927 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.102680 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-432fp4lccq1cg\"" Jul 22 17:19:43.102927 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.102719 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 22 17:19:43.102927 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.102861 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 22 17:19:43.106486 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.106467 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 22 17:19:43.110901 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.110883 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 22 17:19:43.115680 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.115654 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 17:19:43.194901 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.194866 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195050 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.194908 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195050 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.194941 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195050 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.194965 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195050 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.194984 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6fbc\" (UniqueName: \"kubernetes.io/projected/3830e3ff-c629-47c5-af7f-2c58415f5baf-kube-api-access-j6fbc\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195050 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.195007 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195050 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.195049 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195253 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.195073 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195253 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.195096 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195253 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.195125 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195253 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.195151 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-config\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195253 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.195168 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3830e3ff-c629-47c5-af7f-2c58415f5baf-config-out\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195253 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.195204 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3830e3ff-c629-47c5-af7f-2c58415f5baf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195253 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.195241 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195486 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.195269 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195486 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.195284 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195486 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.195300 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-web-config\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195486 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.195314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3830e3ff-c629-47c5-af7f-2c58415f5baf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195486 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.195332 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.195486 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.195379 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296001 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.295928 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296001 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.295967 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296001 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.295987 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296216 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296005 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296216 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296029 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6fbc\" (UniqueName: \"kubernetes.io/projected/3830e3ff-c629-47c5-af7f-2c58415f5baf-kube-api-access-j6fbc\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296216 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296059 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296216 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296088 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296216 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296123 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296216 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296154 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296216 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296183 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296216 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296212 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-config\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296591 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296238 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3830e3ff-c629-47c5-af7f-2c58415f5baf-config-out\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296591 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296265 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3830e3ff-c629-47c5-af7f-2c58415f5baf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296591 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296296 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296591 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296336 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296591 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296384 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296591 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296420 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-web-config\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296591 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296448 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3830e3ff-c629-47c5-af7f-2c58415f5baf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296591 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296492 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.296591 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296550 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.297034 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296728 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.297034 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296812 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.297034 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.296833 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.297294 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.297269 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.299141 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.299108 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.299265 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.299217 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.299265 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.299226 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.299379 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.299277 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.299536 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.299488 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-config\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.299536 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.299511 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3830e3ff-c629-47c5-af7f-2c58415f5baf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.299805 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.299755 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.299940 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.299898 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.300369 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.300342 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.300860 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.300839 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.301459 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.301428 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-web-config\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.301990 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.301960 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3830e3ff-c629-47c5-af7f-2c58415f5baf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.301990 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.301985 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3830e3ff-c629-47c5-af7f-2c58415f5baf-config-out\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.302147 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.302066 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3830e3ff-c629-47c5-af7f-2c58415f5baf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.302296 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.302279 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3830e3ff-c629-47c5-af7f-2c58415f5baf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.315753 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.315728 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6fbc\" (UniqueName: \"kubernetes.io/projected/3830e3ff-c629-47c5-af7f-2c58415f5baf-kube-api-access-j6fbc\") pod \"prometheus-k8s-0\" (UID: \"3830e3ff-c629-47c5-af7f-2c58415f5baf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.409824 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.409783 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:19:43.554642 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:43.554515 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 17:19:43.559906 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:19:43.559871 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3830e3ff_c629_47c5_af7f_2c58415f5baf.slice/crio-6cac069da2b5cba3e582234cda3c545636ad34ea573ca085783635e5f37fceae WatchSource:0}: Error finding container 6cac069da2b5cba3e582234cda3c545636ad34ea573ca085783635e5f37fceae: Status 404 returned error can't find the container with id 6cac069da2b5cba3e582234cda3c545636ad34ea573ca085783635e5f37fceae Jul 22 17:19:44.041782 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:44.041729 2566 generic.go:356] "Generic (PLEG): container finished" podID="3830e3ff-c629-47c5-af7f-2c58415f5baf" containerID="13a92b1a7da766ac841a46ecc2f3d9e468148a79d15d6bf3b91148ac7b125d81" exitCode=0 Jul 22 17:19:44.041782 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:44.041780 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3830e3ff-c629-47c5-af7f-2c58415f5baf","Type":"ContainerDied","Data":"13a92b1a7da766ac841a46ecc2f3d9e468148a79d15d6bf3b91148ac7b125d81"} Jul 22 17:19:44.042232 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:44.041832 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3830e3ff-c629-47c5-af7f-2c58415f5baf","Type":"ContainerStarted","Data":"6cac069da2b5cba3e582234cda3c545636ad34ea573ca085783635e5f37fceae"} Jul 22 17:19:44.237631 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:44.237594 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38057a39-a16f-481e-a3c9-248817e9766a" path="/var/lib/kubelet/pods/38057a39-a16f-481e-a3c9-248817e9766a/volumes" Jul 22 17:19:45.049140 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:45.049104 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3830e3ff-c629-47c5-af7f-2c58415f5baf","Type":"ContainerStarted","Data":"9f206367d0d18039d8f7b11fe4d7f1b8ae09693f266c401500f9e93f893185a6"} Jul 22 17:19:45.049514 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:45.049188 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3830e3ff-c629-47c5-af7f-2c58415f5baf","Type":"ContainerStarted","Data":"24df6ba6ba51749c289c1954c8f40de35ef93ba8c67a6263bf573525797fd4a6"} Jul 22 17:19:45.049514 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:45.049236 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3830e3ff-c629-47c5-af7f-2c58415f5baf","Type":"ContainerStarted","Data":"f48da35d433c8bd22b4e41dd549c0af14a30a631d9dbe6cf033338e512505f12"} Jul 22 17:19:45.049514 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:45.049280 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3830e3ff-c629-47c5-af7f-2c58415f5baf","Type":"ContainerStarted","Data":"1c0d8d99dbd5e4626b6f02efa9c0124adc56c50d0f267da6f3f69f2ffa7c07df"} Jul 22 17:19:45.049514 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:45.049317 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3830e3ff-c629-47c5-af7f-2c58415f5baf","Type":"ContainerStarted","Data":"83e6808938d3d264e6aef1a30b87b0f20ec6499cd9825bb0343d9893573dedb0"} Jul 22 17:19:45.049514 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:45.049357 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3830e3ff-c629-47c5-af7f-2c58415f5baf","Type":"ContainerStarted","Data":"471703837c7b4b9b6cc5780f766dbe362f7498b4803f96e37bdacabac5f5ef40"} Jul 22 17:19:45.083242 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:45.083188 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.060134038 podStartE2EDuration="2.083171504s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.037466ms" isStatefulPod=false podCreationTimestamp="2026-07-22 17:19:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:19:45.081853319 +0000 UTC m=+165.493578953" watchObservedRunningTime="2026-07-22 17:19:45.083171504 +0000 UTC m=+165.494897112" Jul 22 17:19:48.410382 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:19:48.410345 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:20:43.410904 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:20:43.410857 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:20:43.426430 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:20:43.426399 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:20:44.280724 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:20:44.280696 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 17:21:59.978017 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:21:59.977989 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 17:23:18.977031 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:18.976999 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9"] Jul 22 17:23:18.980420 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:18.980405 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:18.982713 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:18.982677 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jul 22 17:23:18.983105 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:18.983080 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jul 22 17:23:18.983489 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:18.983469 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Jul 22 17:23:18.983640 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:18.983617 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 22 17:23:18.983722 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:18.983703 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jul 22 17:23:18.986240 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:18.986210 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jul 22 17:23:18.986240 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:18.986232 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 22 17:23:18.986405 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:18.986240 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-drj9s\"" Jul 22 17:23:18.999995 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:18.999970 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9"] Jul 22 17:23:19.046004 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.045969 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-registry-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.046170 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.046019 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzc4s\" (UniqueName: \"kubernetes.io/projected/74e63643-bc37-40f1-8ac1-02470852a427-kube-api-access-dzc4s\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.046170 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.046048 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/74e63643-bc37-40f1-8ac1-02470852a427-feast-data\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.046170 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.046067 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-online-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.046170 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.046098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-offline-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.046170 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.046158 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-ui-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.147090 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.147046 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzc4s\" (UniqueName: \"kubernetes.io/projected/74e63643-bc37-40f1-8ac1-02470852a427-kube-api-access-dzc4s\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.147282 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.147111 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/74e63643-bc37-40f1-8ac1-02470852a427-feast-data\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.147282 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.147148 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-online-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.147282 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.147200 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-offline-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.147282 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.147232 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-ui-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.147282 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.147264 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-registry-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.147547 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:23:19.147367 2566 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jul 22 17:23:19.147547 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:23:19.147477 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-ui-tls podName:74e63643-bc37-40f1-8ac1-02470852a427 nodeName:}" failed. No retries permitted until 2026-07-22 17:23:19.647457649 +0000 UTC m=+380.059183252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-ui-tls") pod "feast-simple-feast-setup-7fcf5cb988-69zc9" (UID: "74e63643-bc37-40f1-8ac1-02470852a427") : secret "feast-simple-feast-setup-ui-tls" not found Jul 22 17:23:19.147664 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.147541 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/74e63643-bc37-40f1-8ac1-02470852a427-feast-data\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.149702 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.149676 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-online-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.149846 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.149752 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-registry-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.149846 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.149833 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-offline-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.159590 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.159566 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzc4s\" (UniqueName: \"kubernetes.io/projected/74e63643-bc37-40f1-8ac1-02470852a427-kube-api-access-dzc4s\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.653058 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.653005 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-ui-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.655489 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.655462 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-ui-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-69zc9\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:19.906019 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:19.905934 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:23:20.046407 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:20.046343 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9"] Jul 22 17:23:20.048621 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:23:20.048594 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74e63643_bc37_40f1_8ac1_02470852a427.slice/crio-1a6c3c3ab3aae0ed576bdecb5160cd570d6bb080401f4cbffe0a2852e774421a WatchSource:0}: Error finding container 1a6c3c3ab3aae0ed576bdecb5160cd570d6bb080401f4cbffe0a2852e774421a: Status 404 returned error can't find the container with id 1a6c3c3ab3aae0ed576bdecb5160cd570d6bb080401f4cbffe0a2852e774421a Jul 22 17:23:20.050413 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:20.050394 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 17:23:20.822217 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:20.822172 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" event={"ID":"74e63643-bc37-40f1-8ac1-02470852a427","Type":"ContainerStarted","Data":"1a6c3c3ab3aae0ed576bdecb5160cd570d6bb080401f4cbffe0a2852e774421a"} Jul 22 17:23:49.939307 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:49.939223 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" event={"ID":"74e63643-bc37-40f1-8ac1-02470852a427","Type":"ContainerStarted","Data":"15443dbaa03b01f8626cb09c9d740e347be3c7489f8eece41feaf0914d6ddd55"} Jul 22 17:23:54.959478 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:54.959386 2566 generic.go:356] "Generic (PLEG): container finished" podID="74e63643-bc37-40f1-8ac1-02470852a427" containerID="15443dbaa03b01f8626cb09c9d740e347be3c7489f8eece41feaf0914d6ddd55" exitCode=0 Jul 22 17:23:54.959478 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:54.959430 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" event={"ID":"74e63643-bc37-40f1-8ac1-02470852a427","Type":"ContainerDied","Data":"15443dbaa03b01f8626cb09c9d740e347be3c7489f8eece41feaf0914d6ddd55"} Jul 22 17:23:55.965207 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:23:55.965158 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" event={"ID":"74e63643-bc37-40f1-8ac1-02470852a427","Type":"ContainerStarted","Data":"1c6ac7451361818070c74bfae02bd7e1bb9d881d870c151b493d38104536da0e"} Jul 22 17:24:00.985532 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:00.985495 2566 generic.go:356] "Generic (PLEG): container finished" podID="74e63643-bc37-40f1-8ac1-02470852a427" containerID="1c6ac7451361818070c74bfae02bd7e1bb9d881d870c151b493d38104536da0e" exitCode=0 Jul 22 17:24:00.985919 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:00.985541 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" event={"ID":"74e63643-bc37-40f1-8ac1-02470852a427","Type":"ContainerDied","Data":"1c6ac7451361818070c74bfae02bd7e1bb9d881d870c151b493d38104536da0e"} Jul 22 17:24:00.994663 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:00.994639 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Jul 22 17:24:01.996397 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:01.996346 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" event={"ID":"74e63643-bc37-40f1-8ac1-02470852a427","Type":"ContainerStarted","Data":"88358d9d223953eec1136d60081dbec3037cb87fc16ae18194c629685cfa2147"} Jul 22 17:24:01.996874 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:01.996416 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" event={"ID":"74e63643-bc37-40f1-8ac1-02470852a427","Type":"ContainerStarted","Data":"3ec1c1c75e20e58c79309414521b810aee40f50eb2d3642a4d21fbc676b17b75"} Jul 22 17:24:01.996874 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:01.996440 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" event={"ID":"74e63643-bc37-40f1-8ac1-02470852a427","Type":"ContainerStarted","Data":"d491fb6557e162c3b35bbf831e75cffcb4feb9d60f8ad6fcf308d3126034da01"} Jul 22 17:24:01.996874 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:01.996463 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" event={"ID":"74e63643-bc37-40f1-8ac1-02470852a427","Type":"ContainerStarted","Data":"234c076f1cf338f1771a9d330176ae9b0f2f5eac42b3ca4a9dcc8cea29751a84"} Jul 22 17:24:02.022639 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:02.022552 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" podStartSLOduration=14.390531202 podStartE2EDuration="44.02252977s" totalImagesPullingTime="29.631998568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:24:02.020498171 +0000 UTC m=+422.432223782" watchObservedRunningTime="2026-07-22 17:24:02.02252977 +0000 UTC m=+422.434255380" Jul 22 17:24:04.906784 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:04.906727 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:24:04.907287 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:04.906817 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:24:04.907287 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:04.906837 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:24:04.907287 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:04.906858 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:24:04.909020 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:04.908966 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused" Jul 22 17:24:04.909020 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:04.908998 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.18:8816: connect: connection refused" Jul 22 17:24:04.909226 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:04.909022 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="online" probeResult="failure" output="Get \"https://10.133.0.18:6567/health\": dial tcp 10.133.0.18:6567: connect: connection refused" Jul 22 17:24:04.909347 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:04.909315 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.18:6571: connect: connection refused" Jul 22 17:24:07.908088 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:07.908051 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:24:07.908542 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:07.908252 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:24:07.908583 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:07.908542 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:24:07.908689 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:07.908665 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:24:07.908998 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:07.908984 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:24:07.909115 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:07.909104 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:24:07.909251 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:07.909235 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:24:07.909334 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:07.909289 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:24:07.909334 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:07.909333 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:24:07.913750 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:07.913725 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:24:08.028815 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:08.028749 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:24:08.032076 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:24:08.032052 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:25:10.243452 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.243414 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9"] Jul 22 17:25:10.244028 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.243730 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="registry" containerID="cri-o://234c076f1cf338f1771a9d330176ae9b0f2f5eac42b3ca4a9dcc8cea29751a84" gracePeriod=30 Jul 22 17:25:10.244028 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.243776 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="offline" containerID="cri-o://3ec1c1c75e20e58c79309414521b810aee40f50eb2d3642a4d21fbc676b17b75" gracePeriod=30 Jul 22 17:25:10.244028 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.243776 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="online" containerID="cri-o://d491fb6557e162c3b35bbf831e75cffcb4feb9d60f8ad6fcf308d3126034da01" gracePeriod=30 Jul 22 17:25:10.244028 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.243785 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="ui" containerID="cri-o://88358d9d223953eec1136d60081dbec3037cb87fc16ae18194c629685cfa2147" gracePeriod=30 Jul 22 17:25:10.556590 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.556496 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr"] Jul 22 17:25:10.559128 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.559109 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:10.561711 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.561684 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-7t2hl\"" Jul 22 17:25:10.579231 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.579201 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr"] Jul 22 17:25:10.709173 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.709138 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-offline-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:10.709337 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.709189 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-registry-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:10.709337 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.709225 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8d81c970-daab-4baa-ae74-6cfac714474f-feast-data\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:10.709337 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.709254 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9vz2\" (UniqueName: \"kubernetes.io/projected/8d81c970-daab-4baa-ae74-6cfac714474f-kube-api-access-h9vz2\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:10.709337 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.709326 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-ui-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:10.709473 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.709357 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-online-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:10.809895 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.809790 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-offline-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:10.809895 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.809841 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-registry-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:10.809895 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.809870 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8d81c970-daab-4baa-ae74-6cfac714474f-feast-data\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:10.810180 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:25:10.809972 2566 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Jul 22 17:25:10.810180 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.809989 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9vz2\" (UniqueName: \"kubernetes.io/projected/8d81c970-daab-4baa-ae74-6cfac714474f-kube-api-access-h9vz2\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:10.810180 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:25:10.810044 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-registry-tls podName:8d81c970-daab-4baa-ae74-6cfac714474f nodeName:}" failed. No retries permitted until 2026-07-22 17:25:11.310024389 +0000 UTC m=+491.721749979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-registry-tls") pod "feast-simple-feast-setup-7fcf5cb988-5jnzr" (UID: "8d81c970-daab-4baa-ae74-6cfac714474f") : secret "feast-simple-feast-setup-registry-tls" not found Jul 22 17:25:10.810180 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.810087 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-ui-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:10.810180 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.810115 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-online-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:10.810404 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.810291 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8d81c970-daab-4baa-ae74-6cfac714474f-feast-data\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:10.812738 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.812700 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-online-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:10.812899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.812700 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-ui-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:10.812899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.812835 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-offline-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:10.818550 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:10.818523 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9vz2\" (UniqueName: \"kubernetes.io/projected/8d81c970-daab-4baa-ae74-6cfac714474f-kube-api-access-h9vz2\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:11.266074 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:11.266042 2566 generic.go:356] "Generic (PLEG): container finished" podID="74e63643-bc37-40f1-8ac1-02470852a427" containerID="88358d9d223953eec1136d60081dbec3037cb87fc16ae18194c629685cfa2147" exitCode=0 Jul 22 17:25:11.266074 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:11.266066 2566 generic.go:356] "Generic (PLEG): container finished" podID="74e63643-bc37-40f1-8ac1-02470852a427" containerID="d491fb6557e162c3b35bbf831e75cffcb4feb9d60f8ad6fcf308d3126034da01" exitCode=0 Jul 22 17:25:11.266482 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:11.266118 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" event={"ID":"74e63643-bc37-40f1-8ac1-02470852a427","Type":"ContainerDied","Data":"88358d9d223953eec1136d60081dbec3037cb87fc16ae18194c629685cfa2147"} Jul 22 17:25:11.266482 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:11.266159 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" event={"ID":"74e63643-bc37-40f1-8ac1-02470852a427","Type":"ContainerDied","Data":"d491fb6557e162c3b35bbf831e75cffcb4feb9d60f8ad6fcf308d3126034da01"} Jul 22 17:25:11.314667 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:11.314630 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-registry-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:11.317119 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:11.317093 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-registry-tls\") pod \"feast-simple-feast-setup-7fcf5cb988-5jnzr\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:11.468407 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:11.468370 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:11.626470 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:11.626442 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr"] Jul 22 17:25:11.628990 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:25:11.628964 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d81c970_daab_4baa_ae74_6cfac714474f.slice/crio-85a6fea4068ffdde3b67fe5461635c9c4f6fd74e5d83c485977145ae0b4aa430 WatchSource:0}: Error finding container 85a6fea4068ffdde3b67fe5461635c9c4f6fd74e5d83c485977145ae0b4aa430: Status 404 returned error can't find the container with id 85a6fea4068ffdde3b67fe5461635c9c4f6fd74e5d83c485977145ae0b4aa430 Jul 22 17:25:12.276116 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:12.276070 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" event={"ID":"8d81c970-daab-4baa-ae74-6cfac714474f","Type":"ContainerStarted","Data":"a327777a0527a86ec763a9efadf4bf8bc50110f489dd8acd7b7b87f135396eca"} Jul 22 17:25:12.276500 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:12.276126 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" event={"ID":"8d81c970-daab-4baa-ae74-6cfac714474f","Type":"ContainerStarted","Data":"85a6fea4068ffdde3b67fe5461635c9c4f6fd74e5d83c485977145ae0b4aa430"} Jul 22 17:25:17.297302 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:17.297268 2566 generic.go:356] "Generic (PLEG): container finished" podID="8d81c970-daab-4baa-ae74-6cfac714474f" containerID="a327777a0527a86ec763a9efadf4bf8bc50110f489dd8acd7b7b87f135396eca" exitCode=0 Jul 22 17:25:17.297825 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:17.297344 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" event={"ID":"8d81c970-daab-4baa-ae74-6cfac714474f","Type":"ContainerDied","Data":"a327777a0527a86ec763a9efadf4bf8bc50110f489dd8acd7b7b87f135396eca"} Jul 22 17:25:17.909056 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:17.909011 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused" Jul 22 17:25:18.029856 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:18.029817 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="online" probeResult="failure" output="Get \"https://10.133.0.18:6567/health\": dial tcp 10.133.0.18:6567: connect: connection refused" Jul 22 17:25:18.303714 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:18.303623 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" event={"ID":"8d81c970-daab-4baa-ae74-6cfac714474f","Type":"ContainerStarted","Data":"46c54bc9f084ec5f02851ce56b90fcbea140bb446af03db005d72507c58ac550"} Jul 22 17:25:23.325815 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:23.325779 2566 generic.go:356] "Generic (PLEG): container finished" podID="8d81c970-daab-4baa-ae74-6cfac714474f" containerID="46c54bc9f084ec5f02851ce56b90fcbea140bb446af03db005d72507c58ac550" exitCode=0 Jul 22 17:25:23.326200 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:23.325835 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" event={"ID":"8d81c970-daab-4baa-ae74-6cfac714474f","Type":"ContainerDied","Data":"46c54bc9f084ec5f02851ce56b90fcbea140bb446af03db005d72507c58ac550"} Jul 22 17:25:24.336104 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:24.336054 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" event={"ID":"8d81c970-daab-4baa-ae74-6cfac714474f","Type":"ContainerStarted","Data":"ea2d602c9aba3c95456f6278fd78e4fb0d27334ff321f05d63194584c4e29403"} Jul 22 17:25:24.336672 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:24.336126 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" event={"ID":"8d81c970-daab-4baa-ae74-6cfac714474f","Type":"ContainerStarted","Data":"fbfadd6cba71f7ee450e448e52496ab7e263879ef9137bfba873cf43425067d4"} Jul 22 17:25:24.336672 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:24.336147 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" event={"ID":"8d81c970-daab-4baa-ae74-6cfac714474f","Type":"ContainerStarted","Data":"4cfe1b54007b7badb219aeb462c504d20c95cc7b40f67253d542ec65a5ba68e3"} Jul 22 17:25:24.336672 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:24.336164 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" event={"ID":"8d81c970-daab-4baa-ae74-6cfac714474f","Type":"ContainerStarted","Data":"e47ff3fa7e1f269e3587094ac6c38133a244e996d86be778d758f91c1a09fe0d"} Jul 22 17:25:26.469426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:26.469383 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:26.469935 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:26.469453 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:26.469935 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:26.469473 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:26.469935 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:26.469492 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:26.471412 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:26.471370 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.19:6571: connect: connection refused" Jul 22 17:25:26.471550 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:26.471401 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.19:8816: connect: connection refused" Jul 22 17:25:26.471550 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:26.471413 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Jul 22 17:25:26.471550 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:26.471451 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused" Jul 22 17:25:27.909491 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:27.909434 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused" Jul 22 17:25:28.029919 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:28.029867 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="online" probeResult="failure" output="Get \"https://10.133.0.18:6567/health\": dial tcp 10.133.0.18:6567: connect: connection refused" Jul 22 17:25:29.469124 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:29.469079 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused" Jul 22 17:25:29.469679 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:29.469649 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:29.470277 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:29.470252 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:29.470380 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:29.470286 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:29.470929 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:29.470905 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:29.475386 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:29.475363 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:29.493650 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:29.493596 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" podStartSLOduration=19.493580248 podStartE2EDuration="19.493580248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:25:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:25:24.359009982 +0000 UTC m=+504.770735592" watchObservedRunningTime="2026-07-22 17:25:29.493580248 +0000 UTC m=+509.905305861" Jul 22 17:25:30.367183 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:30.367145 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:30.367183 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:30.367187 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:30.367618 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:30.367597 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:30.370370 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:30.370352 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:31.469565 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:31.469526 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:32.470027 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:32.469999 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:33.378246 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:33.378223 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:25:37.909742 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:37.909690 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused" Jul 22 17:25:37.910239 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:37.909896 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:25:38.029243 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:38.029196 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="online" probeResult="failure" output="Get \"https://10.133.0.18:6567/health\": dial tcp 10.133.0.18:6567: connect: connection refused" Jul 22 17:25:38.029412 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:38.029343 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:25:40.405423 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:40.405392 2566 generic.go:356] "Generic (PLEG): container finished" podID="74e63643-bc37-40f1-8ac1-02470852a427" containerID="3ec1c1c75e20e58c79309414521b810aee40f50eb2d3642a4d21fbc676b17b75" exitCode=137 Jul 22 17:25:40.405423 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:40.405416 2566 generic.go:356] "Generic (PLEG): container finished" podID="74e63643-bc37-40f1-8ac1-02470852a427" containerID="234c076f1cf338f1771a9d330176ae9b0f2f5eac42b3ca4a9dcc8cea29751a84" exitCode=137 Jul 22 17:25:40.405423 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:40.405437 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" event={"ID":"74e63643-bc37-40f1-8ac1-02470852a427","Type":"ContainerDied","Data":"3ec1c1c75e20e58c79309414521b810aee40f50eb2d3642a4d21fbc676b17b75"} Jul 22 17:25:40.405892 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:40.405470 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" event={"ID":"74e63643-bc37-40f1-8ac1-02470852a427","Type":"ContainerDied","Data":"234c076f1cf338f1771a9d330176ae9b0f2f5eac42b3ca4a9dcc8cea29751a84"} Jul 22 17:25:40.895659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:40.895633 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:25:40.977333 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:40.977292 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-offline-tls\") pod \"74e63643-bc37-40f1-8ac1-02470852a427\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " Jul 22 17:25:40.977542 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:40.977377 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzc4s\" (UniqueName: \"kubernetes.io/projected/74e63643-bc37-40f1-8ac1-02470852a427-kube-api-access-dzc4s\") pod \"74e63643-bc37-40f1-8ac1-02470852a427\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " Jul 22 17:25:40.977542 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:40.977499 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-ui-tls\") pod \"74e63643-bc37-40f1-8ac1-02470852a427\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " Jul 22 17:25:40.977663 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:40.977550 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/74e63643-bc37-40f1-8ac1-02470852a427-feast-data\") pod \"74e63643-bc37-40f1-8ac1-02470852a427\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " Jul 22 17:25:40.977663 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:40.977592 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-registry-tls\") pod \"74e63643-bc37-40f1-8ac1-02470852a427\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " Jul 22 17:25:40.977663 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:40.977608 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-online-tls\") pod \"74e63643-bc37-40f1-8ac1-02470852a427\" (UID: \"74e63643-bc37-40f1-8ac1-02470852a427\") " Jul 22 17:25:40.978190 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:40.978130 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74e63643-bc37-40f1-8ac1-02470852a427-feast-data" (OuterVolumeSpecName: "feast-data") pod "74e63643-bc37-40f1-8ac1-02470852a427" (UID: "74e63643-bc37-40f1-8ac1-02470852a427"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:25:40.979968 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:40.979931 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "74e63643-bc37-40f1-8ac1-02470852a427" (UID: "74e63643-bc37-40f1-8ac1-02470852a427"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:25:40.980069 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:40.980019 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e63643-bc37-40f1-8ac1-02470852a427-kube-api-access-dzc4s" (OuterVolumeSpecName: "kube-api-access-dzc4s") pod "74e63643-bc37-40f1-8ac1-02470852a427" (UID: "74e63643-bc37-40f1-8ac1-02470852a427"). InnerVolumeSpecName "kube-api-access-dzc4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:25:40.980170 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:40.980131 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-online-tls" (OuterVolumeSpecName: "online-tls") pod "74e63643-bc37-40f1-8ac1-02470852a427" (UID: "74e63643-bc37-40f1-8ac1-02470852a427"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:25:40.980273 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:40.980166 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "74e63643-bc37-40f1-8ac1-02470852a427" (UID: "74e63643-bc37-40f1-8ac1-02470852a427"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:25:40.980273 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:40.980252 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "74e63643-bc37-40f1-8ac1-02470852a427" (UID: "74e63643-bc37-40f1-8ac1-02470852a427"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:25:41.078441 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:41.078343 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-registry-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:25:41.078441 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:41.078375 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-online-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:25:41.078441 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:41.078383 2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-offline-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:25:41.078441 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:41.078391 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzc4s\" (UniqueName: \"kubernetes.io/projected/74e63643-bc37-40f1-8ac1-02470852a427-kube-api-access-dzc4s\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:25:41.078441 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:41.078399 2566 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/74e63643-bc37-40f1-8ac1-02470852a427-ui-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:25:41.078441 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:41.078408 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/74e63643-bc37-40f1-8ac1-02470852a427-feast-data\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:25:41.412394 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:41.412359 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" event={"ID":"74e63643-bc37-40f1-8ac1-02470852a427","Type":"ContainerDied","Data":"1a6c3c3ab3aae0ed576bdecb5160cd570d6bb080401f4cbffe0a2852e774421a"} Jul 22 17:25:41.412866 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:41.412406 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9" Jul 22 17:25:41.412866 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:41.412409 2566 scope.go:117] "RemoveContainer" containerID="88358d9d223953eec1136d60081dbec3037cb87fc16ae18194c629685cfa2147" Jul 22 17:25:41.421706 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:41.421685 2566 scope.go:117] "RemoveContainer" containerID="3ec1c1c75e20e58c79309414521b810aee40f50eb2d3642a4d21fbc676b17b75" Jul 22 17:25:41.429179 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:41.429159 2566 scope.go:117] "RemoveContainer" containerID="d491fb6557e162c3b35bbf831e75cffcb4feb9d60f8ad6fcf308d3126034da01" Jul 22 17:25:41.435628 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:41.435602 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9"] Jul 22 17:25:41.437891 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:41.437860 2566 scope.go:117] "RemoveContainer" containerID="234c076f1cf338f1771a9d330176ae9b0f2f5eac42b3ca4a9dcc8cea29751a84" Jul 22 17:25:41.439485 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:41.439462 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fcf5cb988-69zc9"] Jul 22 17:25:41.446141 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:41.446119 2566 scope.go:117] "RemoveContainer" containerID="1c6ac7451361818070c74bfae02bd7e1bb9d881d870c151b493d38104536da0e" Jul 22 17:25:41.454047 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:41.454022 2566 scope.go:117] "RemoveContainer" containerID="15443dbaa03b01f8626cb09c9d740e347be3c7489f8eece41feaf0914d6ddd55" Jul 22 17:25:42.234922 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:25:42.234881 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74e63643-bc37-40f1-8ac1-02470852a427" path="/var/lib/kubelet/pods/74e63643-bc37-40f1-8ac1-02470852a427/volumes" Jul 22 17:26:36.180189 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.180148 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c"] Jul 22 17:26:36.180659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.180422 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="feast-apply" Jul 22 17:26:36.180659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.180433 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="feast-apply" Jul 22 17:26:36.180659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.180443 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="online" Jul 22 17:26:36.180659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.180448 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="online" Jul 22 17:26:36.180659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.180455 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="feast-init" Jul 22 17:26:36.180659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.180460 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="feast-init" Jul 22 17:26:36.180659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.180471 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="registry" Jul 22 17:26:36.180659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.180476 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="registry" Jul 22 17:26:36.180659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.180486 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="ui" Jul 22 17:26:36.180659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.180491 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="ui" Jul 22 17:26:36.180659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.180499 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="offline" Jul 22 17:26:36.180659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.180504 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="offline" Jul 22 17:26:36.180659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.180554 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="offline" Jul 22 17:26:36.180659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.180562 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="ui" Jul 22 17:26:36.180659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.180567 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="online" Jul 22 17:26:36.180659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.180575 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="74e63643-bc37-40f1-8ac1-02470852a427" containerName="registry" Jul 22 17:26:36.183915 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.183897 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.186623 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.186597 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jul 22 17:26:36.186802 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.186647 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-rcvtt\"" Jul 22 17:26:36.186982 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.186965 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jul 22 17:26:36.187199 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.187176 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jul 22 17:26:36.187312 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.187219 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jul 22 17:26:36.187312 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.187230 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Jul 22 17:26:36.187312 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.187176 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jul 22 17:26:36.187312 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.187183 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jul 22 17:26:36.196208 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.196183 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c"] Jul 22 17:26:36.230257 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.230212 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqnzd\" (UniqueName: \"kubernetes.io/projected/b84784e7-f010-4d92-afd2-632a4a94678a-kube-api-access-tqnzd\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.230257 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.230258 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-offline-tls\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.230505 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.230286 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-online-tls\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.230505 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.230358 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b84784e7-f010-4d92-afd2-632a4a94678a-registry-tls\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.230505 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.230386 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-ui-tls\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.230505 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.230406 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b84784e7-f010-4d92-afd2-632a4a94678a-feast-data\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.331812 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.331750 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-offline-tls\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.331812 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.331820 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-online-tls\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.332081 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.331867 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b84784e7-f010-4d92-afd2-632a4a94678a-registry-tls\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.332081 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.331889 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-ui-tls\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.332081 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.331908 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b84784e7-f010-4d92-afd2-632a4a94678a-feast-data\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.332081 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.331959 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqnzd\" (UniqueName: \"kubernetes.io/projected/b84784e7-f010-4d92-afd2-632a4a94678a-kube-api-access-tqnzd\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.332426 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.332401 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b84784e7-f010-4d92-afd2-632a4a94678a-feast-data\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.332702 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.332680 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b84784e7-f010-4d92-afd2-632a4a94678a-registry-tls\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.334433 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.334404 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-ui-tls\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.334561 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.334433 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-offline-tls\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.334561 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.334484 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-online-tls\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.339831 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.339808 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqnzd\" (UniqueName: \"kubernetes.io/projected/b84784e7-f010-4d92-afd2-632a4a94678a-kube-api-access-tqnzd\") pod \"feast-simple-feast-remote-setup-85f678b577-xjd2c\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.493528 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.493434 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:36.637295 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:36.637252 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c"] Jul 22 17:26:36.641200 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:26:36.641169 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb84784e7_f010_4d92_afd2_632a4a94678a.slice/crio-132b0507668fc6d8478d3974e02253c27988c7080dd2682adb8a9929f294bbfb WatchSource:0}: Error finding container 132b0507668fc6d8478d3974e02253c27988c7080dd2682adb8a9929f294bbfb: Status 404 returned error can't find the container with id 132b0507668fc6d8478d3974e02253c27988c7080dd2682adb8a9929f294bbfb Jul 22 17:26:37.634066 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:37.634023 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" event={"ID":"b84784e7-f010-4d92-afd2-632a4a94678a","Type":"ContainerStarted","Data":"7ecc0d42d2d678b535871dabc17b1791105a2f246d07929aba5545c95fa30db7"} Jul 22 17:26:37.634066 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:37.634070 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" event={"ID":"b84784e7-f010-4d92-afd2-632a4a94678a","Type":"ContainerStarted","Data":"132b0507668fc6d8478d3974e02253c27988c7080dd2682adb8a9929f294bbfb"} Jul 22 17:26:42.655515 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:42.655479 2566 generic.go:356] "Generic (PLEG): container finished" podID="b84784e7-f010-4d92-afd2-632a4a94678a" containerID="7ecc0d42d2d678b535871dabc17b1791105a2f246d07929aba5545c95fa30db7" exitCode=0 Jul 22 17:26:42.655945 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:42.655551 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" event={"ID":"b84784e7-f010-4d92-afd2-632a4a94678a","Type":"ContainerDied","Data":"7ecc0d42d2d678b535871dabc17b1791105a2f246d07929aba5545c95fa30db7"} Jul 22 17:26:43.661620 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:43.661583 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" event={"ID":"b84784e7-f010-4d92-afd2-632a4a94678a","Type":"ContainerStarted","Data":"0129b507f1ad89e0d1586126313dc7be0b4e4db454f24204ce3b549c1572e013"} Jul 22 17:26:49.695697 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:49.695655 2566 generic.go:356] "Generic (PLEG): container finished" podID="b84784e7-f010-4d92-afd2-632a4a94678a" containerID="0129b507f1ad89e0d1586126313dc7be0b4e4db454f24204ce3b549c1572e013" exitCode=0 Jul 22 17:26:49.696102 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:49.695727 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" event={"ID":"b84784e7-f010-4d92-afd2-632a4a94678a","Type":"ContainerDied","Data":"0129b507f1ad89e0d1586126313dc7be0b4e4db454f24204ce3b549c1572e013"} Jul 22 17:26:50.704058 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:50.704016 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" event={"ID":"b84784e7-f010-4d92-afd2-632a4a94678a","Type":"ContainerStarted","Data":"64aa4d59f9606a42a60adef2f13e24ddf6b58c77f7b205456371eb1120994c06"} Jul 22 17:26:50.704546 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:50.704085 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" event={"ID":"b84784e7-f010-4d92-afd2-632a4a94678a","Type":"ContainerStarted","Data":"6184e75b7727820c75956a3c289104ea68fe971a75ccca5a611b88dee9ff9170"} Jul 22 17:26:50.704546 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:50.704110 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" event={"ID":"b84784e7-f010-4d92-afd2-632a4a94678a","Type":"ContainerStarted","Data":"8b473a41d2cbd2cfbb544fffeba3e9a3921f75a67e2bf043c570b6af3436c8df"} Jul 22 17:26:50.743501 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:50.743420 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" podStartSLOduration=14.743394115 podStartE2EDuration="14.743394115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:26:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:26:50.740901598 +0000 UTC m=+591.152627206" watchObservedRunningTime="2026-07-22 17:26:50.743394115 +0000 UTC m=+591.155119724" Jul 22 17:26:51.493659 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:51.493621 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:51.493871 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:51.493785 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:51.493871 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:51.493809 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:51.495602 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:51.495562 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.20:8816: connect: connection refused" Jul 22 17:26:51.495732 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:51.495602 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.20:8443: connect: connection refused" Jul 22 17:26:51.495732 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:51.495603 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.20:6567/health\": dial tcp 10.133.0.20:6567: connect: connection refused" Jul 22 17:26:54.493834 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:54.493789 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.20:8816: connect: connection refused" Jul 22 17:26:54.494331 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:54.493790 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.20:8443: connect: connection refused" Jul 22 17:26:54.494331 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:54.493809 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.20:6567/health\": dial tcp 10.133.0.20:6567: connect: connection refused" Jul 22 17:26:56.494148 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:56.494095 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:56.494148 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:56.494163 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:56.494620 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:56.494179 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:57.494936 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:57.494907 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:57.495395 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:57.495020 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:57.495684 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:57.495665 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:57.495924 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:57.495906 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:57.501411 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:57.501389 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:26:57.741860 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:26:57.741833 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:27:59.461845 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:27:59.461811 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c"] Jul 22 17:27:59.462327 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:27:59.462037 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="online" containerID="cri-o://8b473a41d2cbd2cfbb544fffeba3e9a3921f75a67e2bf043c570b6af3436c8df" gracePeriod=30 Jul 22 17:27:59.462327 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:27:59.462071 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="ui" containerID="cri-o://64aa4d59f9606a42a60adef2f13e24ddf6b58c77f7b205456371eb1120994c06" gracePeriod=30 Jul 22 17:27:59.462327 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:27:59.462111 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="offline" containerID="cri-o://6184e75b7727820c75956a3c289104ea68fe971a75ccca5a611b88dee9ff9170" gracePeriod=30 Jul 22 17:27:59.618946 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:27:59.618908 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr"] Jul 22 17:27:59.619204 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:27:59.619177 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="registry" containerID="cri-o://e47ff3fa7e1f269e3587094ac6c38133a244e996d86be778d758f91c1a09fe0d" gracePeriod=30 Jul 22 17:27:59.619299 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:27:59.619216 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="ui" containerID="cri-o://ea2d602c9aba3c95456f6278fd78e4fb0d27334ff321f05d63194584c4e29403" gracePeriod=30 Jul 22 17:27:59.619299 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:27:59.619235 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="online" containerID="cri-o://4cfe1b54007b7badb219aeb462c504d20c95cc7b40f67253d542ec65a5ba68e3" gracePeriod=30 Jul 22 17:27:59.619398 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:27:59.619216 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="offline" containerID="cri-o://fbfadd6cba71f7ee450e448e52496ab7e263879ef9137bfba873cf43425067d4" gracePeriod=30 Jul 22 17:28:00.367671 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:00.367625 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Jul 22 17:28:00.982396 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:00.982362 2566 generic.go:356] "Generic (PLEG): container finished" podID="b84784e7-f010-4d92-afd2-632a4a94678a" containerID="64aa4d59f9606a42a60adef2f13e24ddf6b58c77f7b205456371eb1120994c06" exitCode=0 Jul 22 17:28:00.982396 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:00.982389 2566 generic.go:356] "Generic (PLEG): container finished" podID="b84784e7-f010-4d92-afd2-632a4a94678a" containerID="8b473a41d2cbd2cfbb544fffeba3e9a3921f75a67e2bf043c570b6af3436c8df" exitCode=0 Jul 22 17:28:00.982959 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:00.982441 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" event={"ID":"b84784e7-f010-4d92-afd2-632a4a94678a","Type":"ContainerDied","Data":"64aa4d59f9606a42a60adef2f13e24ddf6b58c77f7b205456371eb1120994c06"} Jul 22 17:28:00.982959 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:00.982496 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" event={"ID":"b84784e7-f010-4d92-afd2-632a4a94678a","Type":"ContainerDied","Data":"8b473a41d2cbd2cfbb544fffeba3e9a3921f75a67e2bf043c570b6af3436c8df"} Jul 22 17:28:00.988099 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:00.988069 2566 generic.go:356] "Generic (PLEG): container finished" podID="8d81c970-daab-4baa-ae74-6cfac714474f" containerID="ea2d602c9aba3c95456f6278fd78e4fb0d27334ff321f05d63194584c4e29403" exitCode=0 Jul 22 17:28:00.988099 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:00.988094 2566 generic.go:356] "Generic (PLEG): container finished" podID="8d81c970-daab-4baa-ae74-6cfac714474f" containerID="4cfe1b54007b7badb219aeb462c504d20c95cc7b40f67253d542ec65a5ba68e3" exitCode=0 Jul 22 17:28:00.988288 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:00.988134 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" event={"ID":"8d81c970-daab-4baa-ae74-6cfac714474f","Type":"ContainerDied","Data":"ea2d602c9aba3c95456f6278fd78e4fb0d27334ff321f05d63194584c4e29403"} Jul 22 17:28:00.988288 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:00.988169 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" event={"ID":"8d81c970-daab-4baa-ae74-6cfac714474f","Type":"ContainerDied","Data":"4cfe1b54007b7badb219aeb462c504d20c95cc7b40f67253d542ec65a5ba68e3"} Jul 22 17:28:03.377833 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:03.377751 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused" Jul 22 17:28:07.496407 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:07.496362 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.20:8443: connect: connection refused" Jul 22 17:28:07.737288 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:07.737242 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.20:6567/health\": dial tcp 10.133.0.20:6567: connect: connection refused" Jul 22 17:28:10.367427 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:10.367375 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Jul 22 17:28:13.378073 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:13.378027 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused" Jul 22 17:28:17.495620 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:17.495569 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.20:8443: connect: connection refused" Jul 22 17:28:17.738131 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:17.738082 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.20:6567/health\": dial tcp 10.133.0.20:6567: connect: connection refused" Jul 22 17:28:20.367782 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:20.367721 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Jul 22 17:28:20.368191 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:20.367900 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:28:23.378262 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:23.378214 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused" Jul 22 17:28:23.378649 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:23.378336 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:28:27.496120 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:27.496063 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.20:8443: connect: connection refused" Jul 22 17:28:27.496538 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:27.496211 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:28:27.737469 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:27.737421 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.20:6567/health\": dial tcp 10.133.0.20:6567: connect: connection refused" Jul 22 17:28:27.737665 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:27.737568 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:28:30.102440 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.102412 2566 generic.go:356] "Generic (PLEG): container finished" podID="b84784e7-f010-4d92-afd2-632a4a94678a" containerID="6184e75b7727820c75956a3c289104ea68fe971a75ccca5a611b88dee9ff9170" exitCode=137 Jul 22 17:28:30.102869 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.102489 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" event={"ID":"b84784e7-f010-4d92-afd2-632a4a94678a","Type":"ContainerDied","Data":"6184e75b7727820c75956a3c289104ea68fe971a75ccca5a611b88dee9ff9170"} Jul 22 17:28:30.105700 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.105666 2566 generic.go:356] "Generic (PLEG): container finished" podID="8d81c970-daab-4baa-ae74-6cfac714474f" containerID="fbfadd6cba71f7ee450e448e52496ab7e263879ef9137bfba873cf43425067d4" exitCode=137 Jul 22 17:28:30.105700 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.105687 2566 generic.go:356] "Generic (PLEG): container finished" podID="8d81c970-daab-4baa-ae74-6cfac714474f" containerID="e47ff3fa7e1f269e3587094ac6c38133a244e996d86be778d758f91c1a09fe0d" exitCode=137 Jul 22 17:28:30.105905 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.105711 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" event={"ID":"8d81c970-daab-4baa-ae74-6cfac714474f","Type":"ContainerDied","Data":"fbfadd6cba71f7ee450e448e52496ab7e263879ef9137bfba873cf43425067d4"} Jul 22 17:28:30.105905 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.105742 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" event={"ID":"8d81c970-daab-4baa-ae74-6cfac714474f","Type":"ContainerDied","Data":"e47ff3fa7e1f269e3587094ac6c38133a244e996d86be778d758f91c1a09fe0d"} Jul 22 17:28:30.116490 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.116463 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:28:30.213321 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.213290 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-offline-tls\") pod \"b84784e7-f010-4d92-afd2-632a4a94678a\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " Jul 22 17:28:30.213478 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.213370 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b84784e7-f010-4d92-afd2-632a4a94678a-feast-data\") pod \"b84784e7-f010-4d92-afd2-632a4a94678a\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " Jul 22 17:28:30.213478 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.213393 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-online-tls\") pod \"b84784e7-f010-4d92-afd2-632a4a94678a\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " Jul 22 17:28:30.213478 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.213409 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b84784e7-f010-4d92-afd2-632a4a94678a-registry-tls\") pod \"b84784e7-f010-4d92-afd2-632a4a94678a\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " Jul 22 17:28:30.213478 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.213449 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqnzd\" (UniqueName: \"kubernetes.io/projected/b84784e7-f010-4d92-afd2-632a4a94678a-kube-api-access-tqnzd\") pod \"b84784e7-f010-4d92-afd2-632a4a94678a\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " Jul 22 17:28:30.213478 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.213475 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-ui-tls\") pod \"b84784e7-f010-4d92-afd2-632a4a94678a\" (UID: \"b84784e7-f010-4d92-afd2-632a4a94678a\") " Jul 22 17:28:30.213889 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.213855 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b84784e7-f010-4d92-afd2-632a4a94678a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b84784e7-f010-4d92-afd2-632a4a94678a" (UID: "b84784e7-f010-4d92-afd2-632a4a94678a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:28:30.214025 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.213910 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b84784e7-f010-4d92-afd2-632a4a94678a-feast-data" (OuterVolumeSpecName: "feast-data") pod "b84784e7-f010-4d92-afd2-632a4a94678a" (UID: "b84784e7-f010-4d92-afd2-632a4a94678a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:28:30.215779 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.215727 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "b84784e7-f010-4d92-afd2-632a4a94678a" (UID: "b84784e7-f010-4d92-afd2-632a4a94678a"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:28:30.215909 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.215754 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b84784e7-f010-4d92-afd2-632a4a94678a-kube-api-access-tqnzd" (OuterVolumeSpecName: "kube-api-access-tqnzd") pod "b84784e7-f010-4d92-afd2-632a4a94678a" (UID: "b84784e7-f010-4d92-afd2-632a4a94678a"). InnerVolumeSpecName "kube-api-access-tqnzd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:28:30.215972 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.215950 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "b84784e7-f010-4d92-afd2-632a4a94678a" (UID: "b84784e7-f010-4d92-afd2-632a4a94678a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:28:30.216030 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.215978 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-online-tls" (OuterVolumeSpecName: "online-tls") pod "b84784e7-f010-4d92-afd2-632a4a94678a" (UID: "b84784e7-f010-4d92-afd2-632a4a94678a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:28:30.279331 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.279305 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:28:30.314515 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.314480 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-offline-tls\") pod \"8d81c970-daab-4baa-ae74-6cfac714474f\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " Jul 22 17:28:30.314718 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.314549 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-online-tls\") pod \"8d81c970-daab-4baa-ae74-6cfac714474f\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " Jul 22 17:28:30.314718 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.314598 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9vz2\" (UniqueName: \"kubernetes.io/projected/8d81c970-daab-4baa-ae74-6cfac714474f-kube-api-access-h9vz2\") pod \"8d81c970-daab-4baa-ae74-6cfac714474f\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " Jul 22 17:28:30.314718 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.314625 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-ui-tls\") pod \"8d81c970-daab-4baa-ae74-6cfac714474f\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " Jul 22 17:28:30.314718 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.314658 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8d81c970-daab-4baa-ae74-6cfac714474f-feast-data\") pod \"8d81c970-daab-4baa-ae74-6cfac714474f\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " Jul 22 17:28:30.314718 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.314682 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-registry-tls\") pod \"8d81c970-daab-4baa-ae74-6cfac714474f\" (UID: \"8d81c970-daab-4baa-ae74-6cfac714474f\") " Jul 22 17:28:30.315070 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.314953 2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-offline-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:28:30.315070 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.314972 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b84784e7-f010-4d92-afd2-632a4a94678a-feast-data\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:28:30.315070 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.314985 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-online-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:28:30.315070 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.314998 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b84784e7-f010-4d92-afd2-632a4a94678a-registry-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:28:30.315070 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.315013 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqnzd\" (UniqueName: \"kubernetes.io/projected/b84784e7-f010-4d92-afd2-632a4a94678a-kube-api-access-tqnzd\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:28:30.315070 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.315027 2566 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b84784e7-f010-4d92-afd2-632a4a94678a-ui-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:28:30.315353 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.315321 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d81c970-daab-4baa-ae74-6cfac714474f-feast-data" (OuterVolumeSpecName: "feast-data") pod "8d81c970-daab-4baa-ae74-6cfac714474f" (UID: "8d81c970-daab-4baa-ae74-6cfac714474f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:28:30.316873 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.316844 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-online-tls" (OuterVolumeSpecName: "online-tls") pod "8d81c970-daab-4baa-ae74-6cfac714474f" (UID: "8d81c970-daab-4baa-ae74-6cfac714474f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:28:30.316985 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.316891 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "8d81c970-daab-4baa-ae74-6cfac714474f" (UID: "8d81c970-daab-4baa-ae74-6cfac714474f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:28:30.317099 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.317078 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "8d81c970-daab-4baa-ae74-6cfac714474f" (UID: "8d81c970-daab-4baa-ae74-6cfac714474f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:28:30.317147 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.317115 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d81c970-daab-4baa-ae74-6cfac714474f-kube-api-access-h9vz2" (OuterVolumeSpecName: "kube-api-access-h9vz2") pod "8d81c970-daab-4baa-ae74-6cfac714474f" (UID: "8d81c970-daab-4baa-ae74-6cfac714474f"). InnerVolumeSpecName "kube-api-access-h9vz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:28:30.317213 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.317194 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8d81c970-daab-4baa-ae74-6cfac714474f" (UID: "8d81c970-daab-4baa-ae74-6cfac714474f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:28:30.415597 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.415566 2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-offline-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:28:30.415597 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.415592 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-online-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:28:30.415597 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.415601 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9vz2\" (UniqueName: \"kubernetes.io/projected/8d81c970-daab-4baa-ae74-6cfac714474f-kube-api-access-h9vz2\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:28:30.415829 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.415611 2566 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-ui-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:28:30.415829 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.415620 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8d81c970-daab-4baa-ae74-6cfac714474f-feast-data\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:28:30.415829 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:30.415629 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8d81c970-daab-4baa-ae74-6cfac714474f-registry-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:28:31.112507 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.112464 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" event={"ID":"b84784e7-f010-4d92-afd2-632a4a94678a","Type":"ContainerDied","Data":"132b0507668fc6d8478d3974e02253c27988c7080dd2682adb8a9929f294bbfb"} Jul 22 17:28:31.112507 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.112495 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c" Jul 22 17:28:31.113409 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.112525 2566 scope.go:117] "RemoveContainer" containerID="64aa4d59f9606a42a60adef2f13e24ddf6b58c77f7b205456371eb1120994c06" Jul 22 17:28:31.115782 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.115746 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" Jul 22 17:28:31.115923 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.115741 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr" event={"ID":"8d81c970-daab-4baa-ae74-6cfac714474f","Type":"ContainerDied","Data":"85a6fea4068ffdde3b67fe5461635c9c4f6fd74e5d83c485977145ae0b4aa430"} Jul 22 17:28:31.123337 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.123088 2566 scope.go:117] "RemoveContainer" containerID="6184e75b7727820c75956a3c289104ea68fe971a75ccca5a611b88dee9ff9170" Jul 22 17:28:31.131295 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.131270 2566 scope.go:117] "RemoveContainer" containerID="8b473a41d2cbd2cfbb544fffeba3e9a3921f75a67e2bf043c570b6af3436c8df" Jul 22 17:28:31.135033 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.135004 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c"] Jul 22 17:28:31.139663 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.139632 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-85f678b577-xjd2c"] Jul 22 17:28:31.140166 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.140145 2566 scope.go:117] "RemoveContainer" containerID="0129b507f1ad89e0d1586126313dc7be0b4e4db454f24204ce3b549c1572e013" Jul 22 17:28:31.147922 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.147897 2566 scope.go:117] "RemoveContainer" containerID="7ecc0d42d2d678b535871dabc17b1791105a2f246d07929aba5545c95fa30db7" Jul 22 17:28:31.154871 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.154843 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr"] Jul 22 17:28:31.156025 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.156009 2566 scope.go:117] "RemoveContainer" containerID="ea2d602c9aba3c95456f6278fd78e4fb0d27334ff321f05d63194584c4e29403" Jul 22 17:28:31.161025 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.160997 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7fcf5cb988-5jnzr"] Jul 22 17:28:31.164714 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.164697 2566 scope.go:117] "RemoveContainer" containerID="fbfadd6cba71f7ee450e448e52496ab7e263879ef9137bfba873cf43425067d4" Jul 22 17:28:31.174429 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.174407 2566 scope.go:117] "RemoveContainer" containerID="4cfe1b54007b7badb219aeb462c504d20c95cc7b40f67253d542ec65a5ba68e3" Jul 22 17:28:31.182503 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.182484 2566 scope.go:117] "RemoveContainer" containerID="e47ff3fa7e1f269e3587094ac6c38133a244e996d86be778d758f91c1a09fe0d" Jul 22 17:28:31.190466 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.190447 2566 scope.go:117] "RemoveContainer" containerID="46c54bc9f084ec5f02851ce56b90fcbea140bb446af03db005d72507c58ac550" Jul 22 17:28:31.198025 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:31.198004 2566 scope.go:117] "RemoveContainer" containerID="a327777a0527a86ec763a9efadf4bf8bc50110f489dd8acd7b7b87f135396eca" Jul 22 17:28:32.235233 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:32.235202 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" path="/var/lib/kubelet/pods/8d81c970-daab-4baa-ae74-6cfac714474f/volumes" Jul 22 17:28:32.235829 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:32.235814 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" path="/var/lib/kubelet/pods/b84784e7-f010-4d92-afd2-632a4a94678a/volumes" Jul 22 17:28:42.909893 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.909860 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-ct8xt"] Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910144 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="registry" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910158 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="registry" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910172 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="online" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910178 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="online" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910184 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="online" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910191 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="online" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910197 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="feast-init" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910202 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="feast-init" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910208 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="ui" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910213 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="ui" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910220 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="feast-apply" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910224 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="feast-apply" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910233 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="feast-init" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910241 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="feast-init" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910251 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="offline" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910256 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="offline" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910265 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="feast-apply" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910270 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="feast-apply" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910282 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="offline" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910287 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="offline" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910294 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="ui" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910299 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="ui" Jul 22 17:28:42.910357 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910363 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="online" Jul 22 17:28:42.911068 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910372 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="offline" Jul 22 17:28:42.911068 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910378 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="offline" Jul 22 17:28:42.911068 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910385 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="online" Jul 22 17:28:42.911068 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910395 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="ui" Jul 22 17:28:42.911068 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910403 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d81c970-daab-4baa-ae74-6cfac714474f" containerName="registry" Jul 22 17:28:42.911068 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.910408 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b84784e7-f010-4d92-afd2-632a4a94678a" containerName="ui" Jul 22 17:28:42.914976 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.914957 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-ct8xt" Jul 22 17:28:42.918045 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.918022 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 22 17:28:42.918613 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.918594 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 22 17:28:42.918658 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.918594 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-b2sbw\"" Jul 22 17:28:42.925605 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:42.925579 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-ct8xt"] Jul 22 17:28:43.021410 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:43.021368 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcnx2\" (UniqueName: \"kubernetes.io/projected/e6bcbff6-3bf2-427d-baff-292edc19d273-kube-api-access-fcnx2\") pod \"redis-69bbd798b6-ct8xt\" (UID: \"e6bcbff6-3bf2-427d-baff-292edc19d273\") " pod="test-ns-feast/redis-69bbd798b6-ct8xt" Jul 22 17:28:43.121994 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:43.121957 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcnx2\" (UniqueName: \"kubernetes.io/projected/e6bcbff6-3bf2-427d-baff-292edc19d273-kube-api-access-fcnx2\") pod \"redis-69bbd798b6-ct8xt\" (UID: \"e6bcbff6-3bf2-427d-baff-292edc19d273\") " pod="test-ns-feast/redis-69bbd798b6-ct8xt" Jul 22 17:28:43.130985 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:43.130957 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcnx2\" (UniqueName: \"kubernetes.io/projected/e6bcbff6-3bf2-427d-baff-292edc19d273-kube-api-access-fcnx2\") pod \"redis-69bbd798b6-ct8xt\" (UID: \"e6bcbff6-3bf2-427d-baff-292edc19d273\") " pod="test-ns-feast/redis-69bbd798b6-ct8xt" Jul 22 17:28:43.236094 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:43.235989 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-ct8xt" Jul 22 17:28:43.366634 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:43.366600 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-ct8xt"] Jul 22 17:28:43.370830 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:28:43.370747 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6bcbff6_3bf2_427d_baff_292edc19d273.slice/crio-1978c417257aeb5d8764e471ff4b0242e6700c0f59f4445f18492fd0d1ef8074 WatchSource:0}: Error finding container 1978c417257aeb5d8764e471ff4b0242e6700c0f59f4445f18492fd0d1ef8074: Status 404 returned error can't find the container with id 1978c417257aeb5d8764e471ff4b0242e6700c0f59f4445f18492fd0d1ef8074 Jul 22 17:28:43.372614 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:43.372595 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 17:28:44.166027 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:44.165990 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-ct8xt" event={"ID":"e6bcbff6-3bf2-427d-baff-292edc19d273","Type":"ContainerStarted","Data":"1978c417257aeb5d8764e471ff4b0242e6700c0f59f4445f18492fd0d1ef8074"} Jul 22 17:28:45.171136 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:45.171094 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-ct8xt" event={"ID":"e6bcbff6-3bf2-427d-baff-292edc19d273","Type":"ContainerStarted","Data":"372159d5d488986efbff1cad0fa0a6bcf6313b655f18b1219167abdea9feb5d5"} Jul 22 17:28:45.187212 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:45.187157 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-ct8xt" podStartSLOduration=1.836293211 podStartE2EDuration="3.187142259s" totalImagesPullingTime="1.350849048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:28:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:28:45.185373325 +0000 UTC m=+705.597098935" watchObservedRunningTime="2026-07-22 17:28:45.187142259 +0000 UTC m=+705.598867880" Jul 22 17:28:53.519581 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.519498 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn"] Jul 22 17:28:53.523091 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.523071 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:53.525116 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.525096 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Jul 22 17:28:53.525205 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.525096 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\"" Jul 22 17:28:53.525492 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.525472 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\"" Jul 22 17:28:53.525556 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.525537 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Jul 22 17:28:53.525618 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.525566 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-lw9b4\"" Jul 22 17:28:53.525668 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.525627 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\"" Jul 22 17:28:53.537469 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.537442 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn"] Jul 22 17:28:53.712682 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.712645 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5stdq\" (UniqueName: \"kubernetes.io/projected/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-kube-api-access-5stdq\") pod \"feast-credit-scoring-5966bdd576-cn8zn\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:53.712682 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.712689 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-online-tls\") pod \"feast-credit-scoring-5966bdd576-cn8zn\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:53.712962 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.712710 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-feast-data\") pod \"feast-credit-scoring-5966bdd576-cn8zn\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:53.712962 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.712881 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-offline-tls\") pod \"feast-credit-scoring-5966bdd576-cn8zn\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:53.712962 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.712913 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-registry-tls\") pod \"feast-credit-scoring-5966bdd576-cn8zn\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:53.813568 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.813462 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-offline-tls\") pod \"feast-credit-scoring-5966bdd576-cn8zn\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:53.813568 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.813503 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-registry-tls\") pod \"feast-credit-scoring-5966bdd576-cn8zn\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:53.813568 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.813525 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5stdq\" (UniqueName: \"kubernetes.io/projected/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-kube-api-access-5stdq\") pod \"feast-credit-scoring-5966bdd576-cn8zn\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:53.813568 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.813560 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-online-tls\") pod \"feast-credit-scoring-5966bdd576-cn8zn\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:53.813973 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.813588 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-feast-data\") pod \"feast-credit-scoring-5966bdd576-cn8zn\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:53.813973 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:28:53.813638 2566 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found Jul 22 17:28:53.813973 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:28:53.813718 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-registry-tls podName:f259fe13-3d0c-4f80-9128-1bd1a9d75d00 nodeName:}" failed. No retries permitted until 2026-07-22 17:28:54.313696406 +0000 UTC m=+714.725422007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-registry-tls") pod "feast-credit-scoring-5966bdd576-cn8zn" (UID: "f259fe13-3d0c-4f80-9128-1bd1a9d75d00") : secret "feast-credit-scoring-registry-tls" not found Jul 22 17:28:53.814101 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.814029 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-feast-data\") pod \"feast-credit-scoring-5966bdd576-cn8zn\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:53.816068 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.816042 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-online-tls\") pod \"feast-credit-scoring-5966bdd576-cn8zn\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:53.816068 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.816053 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-offline-tls\") pod \"feast-credit-scoring-5966bdd576-cn8zn\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:53.822368 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:53.822346 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5stdq\" (UniqueName: \"kubernetes.io/projected/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-kube-api-access-5stdq\") pod \"feast-credit-scoring-5966bdd576-cn8zn\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:54.317660 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:54.317619 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-registry-tls\") pod \"feast-credit-scoring-5966bdd576-cn8zn\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:54.320105 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:54.320083 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-registry-tls\") pod \"feast-credit-scoring-5966bdd576-cn8zn\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:54.432239 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:54.432195 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:28:54.576717 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:54.576667 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn"] Jul 22 17:28:54.579376 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:28:54.579342 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf259fe13_3d0c_4f80_9128_1bd1a9d75d00.slice/crio-eb7c79b867b57a477fd9a050bf8ac8720ba7e85d673afea54c910a8f3e5fdca2 WatchSource:0}: Error finding container eb7c79b867b57a477fd9a050bf8ac8720ba7e85d673afea54c910a8f3e5fdca2: Status 404 returned error can't find the container with id eb7c79b867b57a477fd9a050bf8ac8720ba7e85d673afea54c910a8f3e5fdca2 Jul 22 17:28:55.208511 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:55.208473 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" event={"ID":"f259fe13-3d0c-4f80-9128-1bd1a9d75d00","Type":"ContainerStarted","Data":"a039fe13e1ff0d47ff535847936211797bc3616d1948014f0d1efd59806d69e3"} Jul 22 17:28:55.208685 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:55.208556 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" event={"ID":"f259fe13-3d0c-4f80-9128-1bd1a9d75d00","Type":"ContainerStarted","Data":"eb7c79b867b57a477fd9a050bf8ac8720ba7e85d673afea54c910a8f3e5fdca2"} Jul 22 17:28:56.213385 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:56.213347 2566 generic.go:356] "Generic (PLEG): container finished" podID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerID="a039fe13e1ff0d47ff535847936211797bc3616d1948014f0d1efd59806d69e3" exitCode=0 Jul 22 17:28:56.213899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:56.213407 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" event={"ID":"f259fe13-3d0c-4f80-9128-1bd1a9d75d00","Type":"ContainerDied","Data":"a039fe13e1ff0d47ff535847936211797bc3616d1948014f0d1efd59806d69e3"} Jul 22 17:28:57.218934 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:28:57.218900 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" event={"ID":"f259fe13-3d0c-4f80-9128-1bd1a9d75d00","Type":"ContainerStarted","Data":"392540d648e079205e0e7bf97aa7d03136a54970fc19c54b2da99b623b55228e"} Jul 22 17:29:04.246912 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:04.246877 2566 generic.go:356] "Generic (PLEG): container finished" podID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerID="392540d648e079205e0e7bf97aa7d03136a54970fc19c54b2da99b623b55228e" exitCode=0 Jul 22 17:29:04.247294 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:04.246937 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" event={"ID":"f259fe13-3d0c-4f80-9128-1bd1a9d75d00","Type":"ContainerDied","Data":"392540d648e079205e0e7bf97aa7d03136a54970fc19c54b2da99b623b55228e"} Jul 22 17:29:04.249957 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:04.249935 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Jul 22 17:29:05.255162 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:05.255121 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" event={"ID":"f259fe13-3d0c-4f80-9128-1bd1a9d75d00","Type":"ContainerStarted","Data":"5695ee6e2a3b01f1888d6e71992560cc91a47b8d3df1e665fe11087d947db87d"} Jul 22 17:29:05.255660 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:05.255199 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" event={"ID":"f259fe13-3d0c-4f80-9128-1bd1a9d75d00","Type":"ContainerStarted","Data":"f8e2b4250ad74b9612eae2ee8c776a036a9c760a95942ad86872c0ece355fcbb"} Jul 22 17:29:05.255660 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:05.255227 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" event={"ID":"f259fe13-3d0c-4f80-9128-1bd1a9d75d00","Type":"ContainerStarted","Data":"588ed6afad2d49f47fcfdac75936e6b6b455a42c0941f2c46c8bcf8181a63650"} Jul 22 17:29:05.298902 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:05.298832 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" podStartSLOduration=12.298807989 podStartE2EDuration="12.298807989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:28:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:29:05.297012355 +0000 UTC m=+725.708737995" watchObservedRunningTime="2026-07-22 17:29:05.298807989 +0000 UTC m=+725.710533600" Jul 22 17:29:06.432974 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:06.432926 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:29:06.433346 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:06.433011 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:29:06.433346 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:06.433039 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:29:06.434892 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:06.434853 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused" Jul 22 17:29:06.435045 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:06.434878 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused" Jul 22 17:29:06.435045 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:06.434911 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Jul 22 17:29:09.433344 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:09.433292 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused" Jul 22 17:29:09.433344 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:09.433323 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Jul 22 17:29:09.433821 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:09.433292 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused" Jul 22 17:29:12.433133 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:12.433083 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused" Jul 22 17:29:12.433780 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:12.433739 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:29:12.434264 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:12.434238 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:29:12.434719 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:12.434693 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:29:12.439514 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:12.439472 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:29:13.292292 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:13.292249 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:29:13.295844 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:13.295812 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:29:14.432755 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:14.432717 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:29:15.433349 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:15.433292 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused" Jul 22 17:29:18.433531 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:18.433501 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:29:18.434320 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:29:18.434298 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:30:24.352150 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:24.352063 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn"] Jul 22 17:30:24.352720 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:24.352307 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="registry" containerID="cri-o://588ed6afad2d49f47fcfdac75936e6b6b455a42c0941f2c46c8bcf8181a63650" gracePeriod=30 Jul 22 17:30:24.352720 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:24.352363 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="offline" containerID="cri-o://5695ee6e2a3b01f1888d6e71992560cc91a47b8d3df1e665fe11087d947db87d" gracePeriod=30 Jul 22 17:30:24.352720 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:24.352362 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="online" containerID="cri-o://f8e2b4250ad74b9612eae2ee8c776a036a9c760a95942ad86872c0ece355fcbb" gracePeriod=30 Jul 22 17:30:24.374965 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:24.374929 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-ct8xt"] Jul 22 17:30:24.375117 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:24.375093 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-ct8xt" podUID="e6bcbff6-3bf2-427d-baff-292edc19d273" containerName="redis" containerID="cri-o://372159d5d488986efbff1cad0fa0a6bcf6313b655f18b1219167abdea9feb5d5" gracePeriod=30 Jul 22 17:30:24.570974 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:24.570936 2566 generic.go:356] "Generic (PLEG): container finished" podID="e6bcbff6-3bf2-427d-baff-292edc19d273" containerID="372159d5d488986efbff1cad0fa0a6bcf6313b655f18b1219167abdea9feb5d5" exitCode=0 Jul 22 17:30:24.570974 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:24.570955 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-ct8xt" event={"ID":"e6bcbff6-3bf2-427d-baff-292edc19d273","Type":"ContainerDied","Data":"372159d5d488986efbff1cad0fa0a6bcf6313b655f18b1219167abdea9feb5d5"} Jul 22 17:30:24.621445 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:24.621420 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-ct8xt" Jul 22 17:30:24.695731 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:24.695703 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcnx2\" (UniqueName: \"kubernetes.io/projected/e6bcbff6-3bf2-427d-baff-292edc19d273-kube-api-access-fcnx2\") pod \"e6bcbff6-3bf2-427d-baff-292edc19d273\" (UID: \"e6bcbff6-3bf2-427d-baff-292edc19d273\") " Jul 22 17:30:24.697783 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:24.697736 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6bcbff6-3bf2-427d-baff-292edc19d273-kube-api-access-fcnx2" (OuterVolumeSpecName: "kube-api-access-fcnx2") pod "e6bcbff6-3bf2-427d-baff-292edc19d273" (UID: "e6bcbff6-3bf2-427d-baff-292edc19d273"). InnerVolumeSpecName "kube-api-access-fcnx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:30:24.796540 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:24.796505 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcnx2\" (UniqueName: \"kubernetes.io/projected/e6bcbff6-3bf2-427d-baff-292edc19d273-kube-api-access-fcnx2\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:30:25.578024 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:25.577935 2566 generic.go:356] "Generic (PLEG): container finished" podID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerID="f8e2b4250ad74b9612eae2ee8c776a036a9c760a95942ad86872c0ece355fcbb" exitCode=0 Jul 22 17:30:25.578024 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:25.578005 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" event={"ID":"f259fe13-3d0c-4f80-9128-1bd1a9d75d00","Type":"ContainerDied","Data":"f8e2b4250ad74b9612eae2ee8c776a036a9c760a95942ad86872c0ece355fcbb"} Jul 22 17:30:25.579189 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:25.579164 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-ct8xt" event={"ID":"e6bcbff6-3bf2-427d-baff-292edc19d273","Type":"ContainerDied","Data":"1978c417257aeb5d8764e471ff4b0242e6700c0f59f4445f18492fd0d1ef8074"} Jul 22 17:30:25.579298 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:25.579200 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-ct8xt" Jul 22 17:30:25.579298 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:25.579203 2566 scope.go:117] "RemoveContainer" containerID="372159d5d488986efbff1cad0fa0a6bcf6313b655f18b1219167abdea9feb5d5" Jul 22 17:30:25.600614 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:25.600585 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-ct8xt"] Jul 22 17:30:25.603489 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:25.603465 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-ct8xt"] Jul 22 17:30:26.234317 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:26.234286 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6bcbff6-3bf2-427d-baff-292edc19d273" path="/var/lib/kubelet/pods/e6bcbff6-3bf2-427d-baff-292edc19d273/volumes" Jul 22 17:30:33.292832 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:33.292754 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Jul 22 17:30:43.292614 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:43.292562 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Jul 22 17:30:53.293424 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:53.293375 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Jul 22 17:30:53.293862 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:53.293521 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:30:54.690777 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:54.690656 2566 generic.go:356] "Generic (PLEG): container finished" podID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerID="5695ee6e2a3b01f1888d6e71992560cc91a47b8d3df1e665fe11087d947db87d" exitCode=137 Jul 22 17:30:54.690777 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:54.690691 2566 generic.go:356] "Generic (PLEG): container finished" podID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerID="588ed6afad2d49f47fcfdac75936e6b6b455a42c0941f2c46c8bcf8181a63650" exitCode=137 Jul 22 17:30:54.690777 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:54.690732 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" event={"ID":"f259fe13-3d0c-4f80-9128-1bd1a9d75d00","Type":"ContainerDied","Data":"5695ee6e2a3b01f1888d6e71992560cc91a47b8d3df1e665fe11087d947db87d"} Jul 22 17:30:54.691180 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:54.690809 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" event={"ID":"f259fe13-3d0c-4f80-9128-1bd1a9d75d00","Type":"ContainerDied","Data":"588ed6afad2d49f47fcfdac75936e6b6b455a42c0941f2c46c8bcf8181a63650"} Jul 22 17:30:54.993562 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:54.993535 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:30:55.039058 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.039029 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5stdq\" (UniqueName: \"kubernetes.io/projected/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-kube-api-access-5stdq\") pod \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " Jul 22 17:30:55.039238 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.039111 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-registry-tls\") pod \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " Jul 22 17:30:55.039238 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.039152 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-feast-data\") pod \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " Jul 22 17:30:55.039238 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.039176 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-offline-tls\") pod \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " Jul 22 17:30:55.039238 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.039220 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-online-tls\") pod \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\" (UID: \"f259fe13-3d0c-4f80-9128-1bd1a9d75d00\") " Jul 22 17:30:55.041621 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.041573 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-online-tls" (OuterVolumeSpecName: "online-tls") pod "f259fe13-3d0c-4f80-9128-1bd1a9d75d00" (UID: "f259fe13-3d0c-4f80-9128-1bd1a9d75d00"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:30:55.041917 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.041860 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f259fe13-3d0c-4f80-9128-1bd1a9d75d00" (UID: "f259fe13-3d0c-4f80-9128-1bd1a9d75d00"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:30:55.042047 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.041978 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-kube-api-access-5stdq" (OuterVolumeSpecName: "kube-api-access-5stdq") pod "f259fe13-3d0c-4f80-9128-1bd1a9d75d00" (UID: "f259fe13-3d0c-4f80-9128-1bd1a9d75d00"). InnerVolumeSpecName "kube-api-access-5stdq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:30:55.042222 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.042197 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f259fe13-3d0c-4f80-9128-1bd1a9d75d00" (UID: "f259fe13-3d0c-4f80-9128-1bd1a9d75d00"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:30:55.051899 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.051869 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-feast-data" (OuterVolumeSpecName: "feast-data") pod "f259fe13-3d0c-4f80-9128-1bd1a9d75d00" (UID: "f259fe13-3d0c-4f80-9128-1bd1a9d75d00"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:30:55.140574 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.140535 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5stdq\" (UniqueName: \"kubernetes.io/projected/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-kube-api-access-5stdq\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:30:55.140574 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.140567 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-registry-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:30:55.140574 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.140576 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-feast-data\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:30:55.140574 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.140584 2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-offline-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:30:55.140877 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.140592 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f259fe13-3d0c-4f80-9128-1bd1a9d75d00-online-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:30:55.697280 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.697240 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" event={"ID":"f259fe13-3d0c-4f80-9128-1bd1a9d75d00","Type":"ContainerDied","Data":"eb7c79b867b57a477fd9a050bf8ac8720ba7e85d673afea54c910a8f3e5fdca2"} Jul 22 17:30:55.697280 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.697278 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn" Jul 22 17:30:55.697831 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.697317 2566 scope.go:117] "RemoveContainer" containerID="5695ee6e2a3b01f1888d6e71992560cc91a47b8d3df1e665fe11087d947db87d" Jul 22 17:30:55.706732 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.706713 2566 scope.go:117] "RemoveContainer" containerID="f8e2b4250ad74b9612eae2ee8c776a036a9c760a95942ad86872c0ece355fcbb" Jul 22 17:30:55.714565 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.714546 2566 scope.go:117] "RemoveContainer" containerID="588ed6afad2d49f47fcfdac75936e6b6b455a42c0941f2c46c8bcf8181a63650" Jul 22 17:30:55.719818 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.719793 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn"] Jul 22 17:30:55.723039 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.722980 2566 scope.go:117] "RemoveContainer" containerID="392540d648e079205e0e7bf97aa7d03136a54970fc19c54b2da99b623b55228e" Jul 22 17:30:55.724474 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.724447 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-5966bdd576-cn8zn"] Jul 22 17:30:55.731040 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:55.731021 2566 scope.go:117] "RemoveContainer" containerID="a039fe13e1ff0d47ff535847936211797bc3616d1948014f0d1efd59806d69e3" Jul 22 17:30:56.234077 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:30:56.234043 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" path="/var/lib/kubelet/pods/f259fe13-3d0c-4f80-9128-1bd1a9d75d00/volumes" Jul 22 17:32:54.182355 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.182319 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-45wfh"] Jul 22 17:32:54.184836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.182597 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6bcbff6-3bf2-427d-baff-292edc19d273" containerName="redis" Jul 22 17:32:54.184836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.182617 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6bcbff6-3bf2-427d-baff-292edc19d273" containerName="redis" Jul 22 17:32:54.184836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.182626 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="feast-apply" Jul 22 17:32:54.184836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.182631 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="feast-apply" Jul 22 17:32:54.184836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.182640 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="online" Jul 22 17:32:54.184836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.182645 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="online" Jul 22 17:32:54.184836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.182657 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="feast-init" Jul 22 17:32:54.184836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.182662 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="feast-init" Jul 22 17:32:54.184836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.182676 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="offline" Jul 22 17:32:54.184836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.182681 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="offline" Jul 22 17:32:54.184836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.182687 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="registry" Jul 22 17:32:54.184836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.182692 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="registry" Jul 22 17:32:54.184836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.182729 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="online" Jul 22 17:32:54.184836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.182737 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="offline" Jul 22 17:32:54.184836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.182742 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6bcbff6-3bf2-427d-baff-292edc19d273" containerName="redis" Jul 22 17:32:54.184836 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.182747 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f259fe13-3d0c-4f80-9128-1bd1a9d75d00" containerName="registry" Jul 22 17:32:54.185779 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.185747 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-45wfh" Jul 22 17:32:54.188150 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.188126 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" Jul 22 17:32:54.188289 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.188128 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-hrkqc\"" Jul 22 17:32:54.188781 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.188745 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" Jul 22 17:32:54.200397 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.200366 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-45wfh"] Jul 22 17:32:54.279233 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.279198 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psx9v\" (UniqueName: \"kubernetes.io/projected/a831e09f-7c80-4293-8e6f-34080e5ffaba-kube-api-access-psx9v\") pod \"redis-69bbd798b6-45wfh\" (UID: \"a831e09f-7c80-4293-8e6f-34080e5ffaba\") " pod="test-ns-feast-rest/redis-69bbd798b6-45wfh" Jul 22 17:32:54.379961 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.379921 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psx9v\" (UniqueName: \"kubernetes.io/projected/a831e09f-7c80-4293-8e6f-34080e5ffaba-kube-api-access-psx9v\") pod \"redis-69bbd798b6-45wfh\" (UID: \"a831e09f-7c80-4293-8e6f-34080e5ffaba\") " pod="test-ns-feast-rest/redis-69bbd798b6-45wfh" Jul 22 17:32:54.388734 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.388698 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psx9v\" (UniqueName: \"kubernetes.io/projected/a831e09f-7c80-4293-8e6f-34080e5ffaba-kube-api-access-psx9v\") pod \"redis-69bbd798b6-45wfh\" (UID: \"a831e09f-7c80-4293-8e6f-34080e5ffaba\") " pod="test-ns-feast-rest/redis-69bbd798b6-45wfh" Jul 22 17:32:54.509745 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.509644 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-45wfh" Jul 22 17:32:54.641843 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:54.641797 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-45wfh"] Jul 22 17:32:54.644739 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:32:54.644711 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda831e09f_7c80_4293_8e6f_34080e5ffaba.slice/crio-87af5e0c5112a98b81401884528c66da54f55a8e75bade3c9c95477d237edaab WatchSource:0}: Error finding container 87af5e0c5112a98b81401884528c66da54f55a8e75bade3c9c95477d237edaab: Status 404 returned error can't find the container with id 87af5e0c5112a98b81401884528c66da54f55a8e75bade3c9c95477d237edaab Jul 22 17:32:55.138905 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:55.138869 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-45wfh" event={"ID":"a831e09f-7c80-4293-8e6f-34080e5ffaba","Type":"ContainerStarted","Data":"d9b1fb47ff621fbbf1a0c1ff7f788b8c45cdc7aa86ab0ec168e03db8ae024511"} Jul 22 17:32:55.138905 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:55.138912 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-45wfh" event={"ID":"a831e09f-7c80-4293-8e6f-34080e5ffaba","Type":"ContainerStarted","Data":"87af5e0c5112a98b81401884528c66da54f55a8e75bade3c9c95477d237edaab"} Jul 22 17:32:55.155225 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:32:55.155173 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-45wfh" podStartSLOduration=1.155157115 podStartE2EDuration="1.155157115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:32:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:32:55.15374455 +0000 UTC m=+955.565470159" watchObservedRunningTime="2026-07-22 17:32:55.155157115 +0000 UTC m=+955.566882723" Jul 22 17:33:05.170941 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.170903 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp"] Jul 22 17:33:05.174314 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.174297 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:05.176328 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.176302 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" Jul 22 17:33:05.176328 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.176301 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\"" Jul 22 17:33:05.176504 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.176303 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\"" Jul 22 17:33:05.176676 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.176661 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\"" Jul 22 17:33:05.176818 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.176801 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-gh9md\"" Jul 22 17:33:05.186845 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.186822 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp"] Jul 22 17:33:05.261038 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.261000 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-online-tls\") pod \"feast-credit-scoring-5698cb96d5-rb6qp\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:05.261222 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.261065 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww5pl\" (UniqueName: \"kubernetes.io/projected/0e235a63-d50c-44a0-b047-e4ad51283699-kube-api-access-ww5pl\") pod \"feast-credit-scoring-5698cb96d5-rb6qp\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:05.261222 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.261163 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-registry-tls\") pod \"feast-credit-scoring-5698cb96d5-rb6qp\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:05.261222 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.261201 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0e235a63-d50c-44a0-b047-e4ad51283699-feast-data\") pod \"feast-credit-scoring-5698cb96d5-rb6qp\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:05.361873 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.361835 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww5pl\" (UniqueName: \"kubernetes.io/projected/0e235a63-d50c-44a0-b047-e4ad51283699-kube-api-access-ww5pl\") pod \"feast-credit-scoring-5698cb96d5-rb6qp\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:05.362027 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.361895 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-registry-tls\") pod \"feast-credit-scoring-5698cb96d5-rb6qp\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:05.362027 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:33:05.361976 2566 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found Jul 22 17:33:05.362027 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.362008 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0e235a63-d50c-44a0-b047-e4ad51283699-feast-data\") pod \"feast-credit-scoring-5698cb96d5-rb6qp\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:05.362130 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:33:05.362033 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-registry-tls podName:0e235a63-d50c-44a0-b047-e4ad51283699 nodeName:}" failed. No retries permitted until 2026-07-22 17:33:05.862015956 +0000 UTC m=+966.273741543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-registry-tls") pod "feast-credit-scoring-5698cb96d5-rb6qp" (UID: "0e235a63-d50c-44a0-b047-e4ad51283699") : secret "feast-credit-scoring-registry-tls" not found Jul 22 17:33:05.362130 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.362052 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-online-tls\") pod \"feast-credit-scoring-5698cb96d5-rb6qp\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:05.362197 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:33:05.362138 2566 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found Jul 22 17:33:05.362197 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:33:05.362165 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-online-tls podName:0e235a63-d50c-44a0-b047-e4ad51283699 nodeName:}" failed. No retries permitted until 2026-07-22 17:33:05.862157559 +0000 UTC m=+966.273883146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-online-tls") pod "feast-credit-scoring-5698cb96d5-rb6qp" (UID: "0e235a63-d50c-44a0-b047-e4ad51283699") : secret "feast-credit-scoring-online-tls" not found Jul 22 17:33:05.362366 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.362349 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0e235a63-d50c-44a0-b047-e4ad51283699-feast-data\") pod \"feast-credit-scoring-5698cb96d5-rb6qp\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:05.372506 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.372474 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww5pl\" (UniqueName: \"kubernetes.io/projected/0e235a63-d50c-44a0-b047-e4ad51283699-kube-api-access-ww5pl\") pod \"feast-credit-scoring-5698cb96d5-rb6qp\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:05.866515 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.866476 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-registry-tls\") pod \"feast-credit-scoring-5698cb96d5-rb6qp\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:05.866515 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.866513 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-online-tls\") pod \"feast-credit-scoring-5698cb96d5-rb6qp\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:05.866747 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:33:05.866625 2566 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found Jul 22 17:33:05.866747 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:33:05.866698 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-online-tls podName:0e235a63-d50c-44a0-b047-e4ad51283699 nodeName:}" failed. No retries permitted until 2026-07-22 17:33:06.866672061 +0000 UTC m=+967.278397648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-online-tls") pod "feast-credit-scoring-5698cb96d5-rb6qp" (UID: "0e235a63-d50c-44a0-b047-e4ad51283699") : secret "feast-credit-scoring-online-tls" not found Jul 22 17:33:05.868933 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:05.868901 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-registry-tls\") pod \"feast-credit-scoring-5698cb96d5-rb6qp\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:06.873056 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:06.873000 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-online-tls\") pod \"feast-credit-scoring-5698cb96d5-rb6qp\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:06.875369 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:06.875349 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-online-tls\") pod \"feast-credit-scoring-5698cb96d5-rb6qp\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:06.983609 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:06.983569 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:07.117029 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:07.116953 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp"] Jul 22 17:33:07.120719 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:33:07.120691 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e235a63_d50c_44a0_b047_e4ad51283699.slice/crio-4b2ccc2784b5a452f46b4258e0c00254a3d530a09fdadef1c56a4ebee4a9f1f0 WatchSource:0}: Error finding container 4b2ccc2784b5a452f46b4258e0c00254a3d530a09fdadef1c56a4ebee4a9f1f0: Status 404 returned error can't find the container with id 4b2ccc2784b5a452f46b4258e0c00254a3d530a09fdadef1c56a4ebee4a9f1f0 Jul 22 17:33:07.184117 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:07.184087 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" event={"ID":"0e235a63-d50c-44a0-b047-e4ad51283699","Type":"ContainerStarted","Data":"4b2ccc2784b5a452f46b4258e0c00254a3d530a09fdadef1c56a4ebee4a9f1f0"} Jul 22 17:33:08.188778 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:08.188727 2566 generic.go:356] "Generic (PLEG): container finished" podID="0e235a63-d50c-44a0-b047-e4ad51283699" containerID="448e1662fd7dd62d785f699a5d8f76695ff85be6a836dcf903d6ae77ae84090f" exitCode=0 Jul 22 17:33:08.189173 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:08.188780 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" event={"ID":"0e235a63-d50c-44a0-b047-e4ad51283699","Type":"ContainerDied","Data":"448e1662fd7dd62d785f699a5d8f76695ff85be6a836dcf903d6ae77ae84090f"} Jul 22 17:33:09.194283 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:09.194246 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" event={"ID":"0e235a63-d50c-44a0-b047-e4ad51283699","Type":"ContainerStarted","Data":"4ba6ddde023e71e8a69c6187d89a10618fdfb9eee0fbf861cd308c36ce881cf6"} Jul 22 17:33:16.224208 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:16.224174 2566 generic.go:356] "Generic (PLEG): container finished" podID="0e235a63-d50c-44a0-b047-e4ad51283699" containerID="4ba6ddde023e71e8a69c6187d89a10618fdfb9eee0fbf861cd308c36ce881cf6" exitCode=0 Jul 22 17:33:16.224208 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:16.224214 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" event={"ID":"0e235a63-d50c-44a0-b047-e4ad51283699","Type":"ContainerDied","Data":"4ba6ddde023e71e8a69c6187d89a10618fdfb9eee0fbf861cd308c36ce881cf6"} Jul 22 17:33:17.232188 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:17.232144 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" event={"ID":"0e235a63-d50c-44a0-b047-e4ad51283699","Type":"ContainerStarted","Data":"039996fd374c3871f8a599ea0d38dde5267507945fda7dff05767a8c4427705b"} Jul 22 17:33:17.232670 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:17.232217 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" event={"ID":"0e235a63-d50c-44a0-b047-e4ad51283699","Type":"ContainerStarted","Data":"9ecec63134c31a6b721421e07eda7ba20aaf920ada675cee228fa7f66799c3f3"} Jul 22 17:33:17.255312 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:17.255249 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" podStartSLOduration=12.255216266 podStartE2EDuration="12.255216266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:33:17.254142745 +0000 UTC m=+977.665868365" watchObservedRunningTime="2026-07-22 17:33:17.255216266 +0000 UTC m=+977.666941876" Jul 22 17:33:18.984740 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:18.984701 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:18.985162 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:18.984794 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:18.986385 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:18.986359 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.24:6571: connect: connection refused" Jul 22 17:33:18.986436 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:18.986409 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused" Jul 22 17:33:21.984400 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:21.984291 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.24:6571: connect: connection refused" Jul 22 17:33:21.984400 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:21.984306 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused" Jul 22 17:33:24.984242 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:24.984182 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.24:6571: connect: connection refused" Jul 22 17:33:24.989845 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:24.989811 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:24.990225 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:24.990196 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:24.993516 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:24.993487 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:26.984622 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:26.984569 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:27.984480 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:27.984417 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.24:6571: connect: connection refused" Jul 22 17:33:30.984984 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:30.984949 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:30.985743 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:30.985725 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:33:36.110384 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.110343 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs"] Jul 22 17:33:36.112733 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.112715 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:36.114895 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.114847 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Jul 22 17:33:36.114895 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.114862 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-7z2b8\"" Jul 22 17:33:36.114895 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.114847 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\"" Jul 22 17:33:36.115109 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.114904 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\"" Jul 22 17:33:36.126041 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.126012 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs"] Jul 22 17:33:36.225805 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.225747 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-registry-tls\") pod \"feast-driver-ranking-6cc8ffd6c4-qpcqs\" (UID: \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\") " pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:36.225997 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.225825 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-feast-data\") pod \"feast-driver-ranking-6cc8ffd6c4-qpcqs\" (UID: \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\") " pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:36.225997 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.225858 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-online-tls\") pod \"feast-driver-ranking-6cc8ffd6c4-qpcqs\" (UID: \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\") " pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:36.225997 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.225890 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrq4n\" (UniqueName: \"kubernetes.io/projected/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-kube-api-access-zrq4n\") pod \"feast-driver-ranking-6cc8ffd6c4-qpcqs\" (UID: \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\") " pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:36.327274 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.327236 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-registry-tls\") pod \"feast-driver-ranking-6cc8ffd6c4-qpcqs\" (UID: \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\") " pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:36.327274 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.327282 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-feast-data\") pod \"feast-driver-ranking-6cc8ffd6c4-qpcqs\" (UID: \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\") " pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:36.327530 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.327306 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-online-tls\") pod \"feast-driver-ranking-6cc8ffd6c4-qpcqs\" (UID: \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\") " pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:36.327530 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.327331 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrq4n\" (UniqueName: \"kubernetes.io/projected/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-kube-api-access-zrq4n\") pod \"feast-driver-ranking-6cc8ffd6c4-qpcqs\" (UID: \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\") " pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:36.327530 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:33:36.327336 2566 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found Jul 22 17:33:36.327530 ip-10-0-139-124 kubenswrapper[2566]: E0722 17:33:36.327411 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-registry-tls podName:86e83a70-dbf0-4e56-8fa0-c8fda82b4605 nodeName:}" failed. No retries permitted until 2026-07-22 17:33:36.827387917 +0000 UTC m=+997.239113514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-registry-tls") pod "feast-driver-ranking-6cc8ffd6c4-qpcqs" (UID: "86e83a70-dbf0-4e56-8fa0-c8fda82b4605") : secret "feast-driver-ranking-registry-tls" not found Jul 22 17:33:36.327805 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.327746 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-feast-data\") pod \"feast-driver-ranking-6cc8ffd6c4-qpcqs\" (UID: \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\") " pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:36.329768 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.329743 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-online-tls\") pod \"feast-driver-ranking-6cc8ffd6c4-qpcqs\" (UID: \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\") " pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:36.339065 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.339038 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrq4n\" (UniqueName: \"kubernetes.io/projected/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-kube-api-access-zrq4n\") pod \"feast-driver-ranking-6cc8ffd6c4-qpcqs\" (UID: \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\") " pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:36.829574 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.829528 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-registry-tls\") pod \"feast-driver-ranking-6cc8ffd6c4-qpcqs\" (UID: \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\") " pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:36.832043 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:36.832015 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-registry-tls\") pod \"feast-driver-ranking-6cc8ffd6c4-qpcqs\" (UID: \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\") " pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:37.022456 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:37.022406 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:37.168988 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:37.168958 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs"] Jul 22 17:33:37.172319 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:33:37.172295 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e83a70_dbf0_4e56_8fa0_c8fda82b4605.slice/crio-bfc076e382a72d0e8f50124ee1f73dab3a0e8d8eb2c856e9ddd3335207eaf4dd WatchSource:0}: Error finding container bfc076e382a72d0e8f50124ee1f73dab3a0e8d8eb2c856e9ddd3335207eaf4dd: Status 404 returned error can't find the container with id bfc076e382a72d0e8f50124ee1f73dab3a0e8d8eb2c856e9ddd3335207eaf4dd Jul 22 17:33:37.315625 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:37.315588 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" event={"ID":"86e83a70-dbf0-4e56-8fa0-c8fda82b4605","Type":"ContainerStarted","Data":"d6948acc56d28f77f4cf51eb21ca1ccdedc70f0afef092a896125f844ec388c2"} Jul 22 17:33:37.315841 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:37.315639 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" event={"ID":"86e83a70-dbf0-4e56-8fa0-c8fda82b4605","Type":"ContainerStarted","Data":"bfc076e382a72d0e8f50124ee1f73dab3a0e8d8eb2c856e9ddd3335207eaf4dd"} Jul 22 17:33:42.337927 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:42.337891 2566 generic.go:356] "Generic (PLEG): container finished" podID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerID="d6948acc56d28f77f4cf51eb21ca1ccdedc70f0afef092a896125f844ec388c2" exitCode=0 Jul 22 17:33:42.338326 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:42.337965 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" event={"ID":"86e83a70-dbf0-4e56-8fa0-c8fda82b4605","Type":"ContainerDied","Data":"d6948acc56d28f77f4cf51eb21ca1ccdedc70f0afef092a896125f844ec388c2"} Jul 22 17:33:43.344450 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:43.344406 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" event={"ID":"86e83a70-dbf0-4e56-8fa0-c8fda82b4605","Type":"ContainerStarted","Data":"d7ee792b695d51ea912b66e7683f774f2a79946be10ca9a9012afce3f78911e5"} Jul 22 17:33:50.372580 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:50.372536 2566 generic.go:356] "Generic (PLEG): container finished" podID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerID="d7ee792b695d51ea912b66e7683f774f2a79946be10ca9a9012afce3f78911e5" exitCode=0 Jul 22 17:33:50.373072 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:50.372604 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" event={"ID":"86e83a70-dbf0-4e56-8fa0-c8fda82b4605","Type":"ContainerDied","Data":"d7ee792b695d51ea912b66e7683f774f2a79946be10ca9a9012afce3f78911e5"} Jul 22 17:33:51.379382 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:51.379337 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" event={"ID":"86e83a70-dbf0-4e56-8fa0-c8fda82b4605","Type":"ContainerStarted","Data":"b4be8b9893f58d5f1d44b0c941d7ecca3c34c3f8dc89b248c8940eb7e4461194"} Jul 22 17:33:51.379803 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:51.379419 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" event={"ID":"86e83a70-dbf0-4e56-8fa0-c8fda82b4605","Type":"ContainerStarted","Data":"96d1166d0c183e2287e1b9bab083c63e0aa79ae1184081104eaf0ce149ee9aaa"} Jul 22 17:33:51.403377 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:51.403311 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" podStartSLOduration=15.403290363 podStartE2EDuration="15.403290363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:33:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:33:51.400738092 +0000 UTC m=+1011.812463704" watchObservedRunningTime="2026-07-22 17:33:51.403290363 +0000 UTC m=+1011.815015975" Jul 22 17:33:52.023359 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:52.023319 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:52.023535 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:52.023393 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:52.025062 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:52.025025 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused" Jul 22 17:33:52.025206 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:52.025065 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Jul 22 17:33:55.023200 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:55.023153 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused" Jul 22 17:33:55.023829 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:55.023221 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Jul 22 17:33:57.023009 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:57.022958 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:57.023410 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:57.023100 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:58.023772 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:58.023721 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused" Jul 22 17:33:58.031980 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:58.031950 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:33:58.036809 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:33:58.036783 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:34:01.023622 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:34:01.023572 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused" Jul 22 17:34:04.023787 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:34:04.023728 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:34:04.024648 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:34:04.024624 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:35:22.306992 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:22.306959 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp"] Jul 22 17:35:22.307550 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:22.307178 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="registry" containerID="cri-o://9ecec63134c31a6b721421e07eda7ba20aaf920ada675cee228fa7f66799c3f3" gracePeriod=30 Jul 22 17:35:22.307550 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:22.307253 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="online" containerID="cri-o://039996fd374c3871f8a599ea0d38dde5267507945fda7dff05767a8c4427705b" gracePeriod=30 Jul 22 17:35:22.313006 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:22.312420 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs"] Jul 22 17:35:22.314588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:22.313910 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="online" containerID="cri-o://b4be8b9893f58d5f1d44b0c941d7ecca3c34c3f8dc89b248c8940eb7e4461194" gracePeriod=30 Jul 22 17:35:22.314588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:22.314079 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="registry" containerID="cri-o://96d1166d0c183e2287e1b9bab083c63e0aa79ae1184081104eaf0ce149ee9aaa" gracePeriod=30 Jul 22 17:35:23.753732 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:23.753690 2566 generic.go:356] "Generic (PLEG): container finished" podID="0e235a63-d50c-44a0-b047-e4ad51283699" containerID="039996fd374c3871f8a599ea0d38dde5267507945fda7dff05767a8c4427705b" exitCode=0 Jul 22 17:35:23.754134 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:23.753782 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" event={"ID":"0e235a63-d50c-44a0-b047-e4ad51283699","Type":"ContainerDied","Data":"039996fd374c3871f8a599ea0d38dde5267507945fda7dff05767a8c4427705b"} Jul 22 17:35:23.756094 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:23.756065 2566 generic.go:356] "Generic (PLEG): container finished" podID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerID="b4be8b9893f58d5f1d44b0c941d7ecca3c34c3f8dc89b248c8940eb7e4461194" exitCode=0 Jul 22 17:35:23.756210 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:23.756131 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" event={"ID":"86e83a70-dbf0-4e56-8fa0-c8fda82b4605","Type":"ContainerDied","Data":"b4be8b9893f58d5f1d44b0c941d7ecca3c34c3f8dc89b248c8940eb7e4461194"} Jul 22 17:35:24.608691 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:24.608653 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-45wfh"] Jul 22 17:35:24.608925 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:24.608892 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-45wfh" podUID="a831e09f-7c80-4293-8e6f-34080e5ffaba" containerName="redis" containerID="cri-o://d9b1fb47ff621fbbf1a0c1ff7f788b8c45cdc7aa86ab0ec168e03db8ae024511" gracePeriod=30 Jul 22 17:35:24.761186 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:24.761157 2566 generic.go:356] "Generic (PLEG): container finished" podID="a831e09f-7c80-4293-8e6f-34080e5ffaba" containerID="d9b1fb47ff621fbbf1a0c1ff7f788b8c45cdc7aa86ab0ec168e03db8ae024511" exitCode=0 Jul 22 17:35:24.761568 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:24.761226 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-45wfh" event={"ID":"a831e09f-7c80-4293-8e6f-34080e5ffaba","Type":"ContainerDied","Data":"d9b1fb47ff621fbbf1a0c1ff7f788b8c45cdc7aa86ab0ec168e03db8ae024511"} Jul 22 17:35:24.852238 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:24.852215 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-45wfh" Jul 22 17:35:24.934887 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:24.934801 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psx9v\" (UniqueName: \"kubernetes.io/projected/a831e09f-7c80-4293-8e6f-34080e5ffaba-kube-api-access-psx9v\") pod \"a831e09f-7c80-4293-8e6f-34080e5ffaba\" (UID: \"a831e09f-7c80-4293-8e6f-34080e5ffaba\") " Jul 22 17:35:24.936977 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:24.936942 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a831e09f-7c80-4293-8e6f-34080e5ffaba-kube-api-access-psx9v" (OuterVolumeSpecName: "kube-api-access-psx9v") pod "a831e09f-7c80-4293-8e6f-34080e5ffaba" (UID: "a831e09f-7c80-4293-8e6f-34080e5ffaba"). InnerVolumeSpecName "kube-api-access-psx9v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:35:24.990527 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:24.990482 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused" Jul 22 17:35:25.036216 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:25.036185 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psx9v\" (UniqueName: \"kubernetes.io/projected/a831e09f-7c80-4293-8e6f-34080e5ffaba-kube-api-access-psx9v\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:35:25.766340 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:25.766311 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-45wfh" Jul 22 17:35:25.766340 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:25.766333 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-45wfh" event={"ID":"a831e09f-7c80-4293-8e6f-34080e5ffaba","Type":"ContainerDied","Data":"87af5e0c5112a98b81401884528c66da54f55a8e75bade3c9c95477d237edaab"} Jul 22 17:35:25.766846 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:25.766379 2566 scope.go:117] "RemoveContainer" containerID="d9b1fb47ff621fbbf1a0c1ff7f788b8c45cdc7aa86ab0ec168e03db8ae024511" Jul 22 17:35:25.785923 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:25.785891 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-45wfh"] Jul 22 17:35:25.787629 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:25.787610 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-45wfh"] Jul 22 17:35:26.234588 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:26.234556 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a831e09f-7c80-4293-8e6f-34080e5ffaba" path="/var/lib/kubelet/pods/a831e09f-7c80-4293-8e6f-34080e5ffaba/volumes" Jul 22 17:35:28.033012 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:28.032976 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Jul 22 17:35:34.990632 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:34.990571 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused" Jul 22 17:35:38.032985 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:38.032943 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Jul 22 17:35:44.990523 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:44.990481 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused" Jul 22 17:35:44.991009 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:44.990622 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:35:48.032809 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:48.032744 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Jul 22 17:35:48.033201 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:48.032873 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:35:52.872414 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:52.872373 2566 generic.go:356] "Generic (PLEG): container finished" podID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerID="96d1166d0c183e2287e1b9bab083c63e0aa79ae1184081104eaf0ce149ee9aaa" exitCode=137 Jul 22 17:35:52.872414 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:52.872401 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" event={"ID":"86e83a70-dbf0-4e56-8fa0-c8fda82b4605","Type":"ContainerDied","Data":"96d1166d0c183e2287e1b9bab083c63e0aa79ae1184081104eaf0ce149ee9aaa"} Jul 22 17:35:52.876134 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:52.876104 2566 generic.go:356] "Generic (PLEG): container finished" podID="0e235a63-d50c-44a0-b047-e4ad51283699" containerID="9ecec63134c31a6b721421e07eda7ba20aaf920ada675cee228fa7f66799c3f3" exitCode=137 Jul 22 17:35:52.876253 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:52.876157 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" event={"ID":"0e235a63-d50c-44a0-b047-e4ad51283699","Type":"ContainerDied","Data":"9ecec63134c31a6b721421e07eda7ba20aaf920ada675cee228fa7f66799c3f3"} Jul 22 17:35:52.993304 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:52.993280 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:35:52.995863 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:52.995843 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:35:53.063855 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.063819 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-online-tls\") pod \"0e235a63-d50c-44a0-b047-e4ad51283699\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " Jul 22 17:35:53.064022 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.063920 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-online-tls\") pod \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\" (UID: \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\") " Jul 22 17:35:53.064022 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.063947 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ww5pl\" (UniqueName: \"kubernetes.io/projected/0e235a63-d50c-44a0-b047-e4ad51283699-kube-api-access-ww5pl\") pod \"0e235a63-d50c-44a0-b047-e4ad51283699\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " Jul 22 17:35:53.064022 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.063966 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-registry-tls\") pod \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\" (UID: \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\") " Jul 22 17:35:53.064022 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.063995 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrq4n\" (UniqueName: \"kubernetes.io/projected/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-kube-api-access-zrq4n\") pod \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\" (UID: \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\") " Jul 22 17:35:53.064237 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.064022 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-registry-tls\") pod \"0e235a63-d50c-44a0-b047-e4ad51283699\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " Jul 22 17:35:53.064237 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.064076 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0e235a63-d50c-44a0-b047-e4ad51283699-feast-data\") pod \"0e235a63-d50c-44a0-b047-e4ad51283699\" (UID: \"0e235a63-d50c-44a0-b047-e4ad51283699\") " Jul 22 17:35:53.064237 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.064100 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-feast-data\") pod \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\" (UID: \"86e83a70-dbf0-4e56-8fa0-c8fda82b4605\") " Jul 22 17:35:53.064946 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.064868 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-feast-data" (OuterVolumeSpecName: "feast-data") pod "86e83a70-dbf0-4e56-8fa0-c8fda82b4605" (UID: "86e83a70-dbf0-4e56-8fa0-c8fda82b4605"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:35:53.066228 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.066200 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-online-tls" (OuterVolumeSpecName: "online-tls") pod "86e83a70-dbf0-4e56-8fa0-c8fda82b4605" (UID: "86e83a70-dbf0-4e56-8fa0-c8fda82b4605"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:35:53.066535 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.066482 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "86e83a70-dbf0-4e56-8fa0-c8fda82b4605" (UID: "86e83a70-dbf0-4e56-8fa0-c8fda82b4605"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:35:53.066535 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.066485 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e235a63-d50c-44a0-b047-e4ad51283699-kube-api-access-ww5pl" (OuterVolumeSpecName: "kube-api-access-ww5pl") pod "0e235a63-d50c-44a0-b047-e4ad51283699" (UID: "0e235a63-d50c-44a0-b047-e4ad51283699"). InnerVolumeSpecName "kube-api-access-ww5pl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:35:53.066535 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.066524 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-online-tls" (OuterVolumeSpecName: "online-tls") pod "0e235a63-d50c-44a0-b047-e4ad51283699" (UID: "0e235a63-d50c-44a0-b047-e4ad51283699"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:35:53.066692 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.066552 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-kube-api-access-zrq4n" (OuterVolumeSpecName: "kube-api-access-zrq4n") pod "86e83a70-dbf0-4e56-8fa0-c8fda82b4605" (UID: "86e83a70-dbf0-4e56-8fa0-c8fda82b4605"). InnerVolumeSpecName "kube-api-access-zrq4n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:35:53.066692 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.066557 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0e235a63-d50c-44a0-b047-e4ad51283699" (UID: "0e235a63-d50c-44a0-b047-e4ad51283699"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:35:53.074445 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.074414 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e235a63-d50c-44a0-b047-e4ad51283699-feast-data" (OuterVolumeSpecName: "feast-data") pod "0e235a63-d50c-44a0-b047-e4ad51283699" (UID: "0e235a63-d50c-44a0-b047-e4ad51283699"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:35:53.165016 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.164970 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0e235a63-d50c-44a0-b047-e4ad51283699-feast-data\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:35:53.165016 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.165013 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-feast-data\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:35:53.165016 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.165023 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-online-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:35:53.165016 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.165031 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-online-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:35:53.165284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.165039 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ww5pl\" (UniqueName: \"kubernetes.io/projected/0e235a63-d50c-44a0-b047-e4ad51283699-kube-api-access-ww5pl\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:35:53.165284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.165049 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-registry-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:35:53.165284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.165057 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrq4n\" (UniqueName: \"kubernetes.io/projected/86e83a70-dbf0-4e56-8fa0-c8fda82b4605-kube-api-access-zrq4n\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:35:53.165284 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.165065 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0e235a63-d50c-44a0-b047-e4ad51283699-registry-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jul 22 17:35:53.882047 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.882023 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" Jul 22 17:35:53.882473 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.882017 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp" event={"ID":"0e235a63-d50c-44a0-b047-e4ad51283699","Type":"ContainerDied","Data":"4b2ccc2784b5a452f46b4258e0c00254a3d530a09fdadef1c56a4ebee4a9f1f0"} Jul 22 17:35:53.882473 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.882166 2566 scope.go:117] "RemoveContainer" containerID="039996fd374c3871f8a599ea0d38dde5267507945fda7dff05767a8c4427705b" Jul 22 17:35:53.884475 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.884450 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" Jul 22 17:35:53.884475 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.884452 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs" event={"ID":"86e83a70-dbf0-4e56-8fa0-c8fda82b4605","Type":"ContainerDied","Data":"bfc076e382a72d0e8f50124ee1f73dab3a0e8d8eb2c856e9ddd3335207eaf4dd"} Jul 22 17:35:53.899383 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.899358 2566 scope.go:117] "RemoveContainer" containerID="9ecec63134c31a6b721421e07eda7ba20aaf920ada675cee228fa7f66799c3f3" Jul 22 17:35:53.907716 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.907691 2566 scope.go:117] "RemoveContainer" containerID="4ba6ddde023e71e8a69c6187d89a10618fdfb9eee0fbf861cd308c36ce881cf6" Jul 22 17:35:53.908884 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.908810 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp"] Jul 22 17:35:53.915406 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.915378 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5698cb96d5-rb6qp"] Jul 22 17:35:53.916596 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.916577 2566 scope.go:117] "RemoveContainer" containerID="448e1662fd7dd62d785f699a5d8f76695ff85be6a836dcf903d6ae77ae84090f" Jul 22 17:35:53.924636 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.924610 2566 scope.go:117] "RemoveContainer" containerID="b4be8b9893f58d5f1d44b0c941d7ecca3c34c3f8dc89b248c8940eb7e4461194" Jul 22 17:35:53.924982 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.924958 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs"] Jul 22 17:35:53.929534 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.929509 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6cc8ffd6c4-qpcqs"] Jul 22 17:35:53.933201 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.933180 2566 scope.go:117] "RemoveContainer" containerID="96d1166d0c183e2287e1b9bab083c63e0aa79ae1184081104eaf0ce149ee9aaa" Jul 22 17:35:53.941053 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.941033 2566 scope.go:117] "RemoveContainer" containerID="d7ee792b695d51ea912b66e7683f774f2a79946be10ca9a9012afce3f78911e5" Jul 22 17:35:53.948216 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:53.948198 2566 scope.go:117] "RemoveContainer" containerID="d6948acc56d28f77f4cf51eb21ca1ccdedc70f0afef092a896125f844ec388c2" Jul 22 17:35:54.235176 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:54.235095 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" path="/var/lib/kubelet/pods/0e235a63-d50c-44a0-b047-e4ad51283699/volumes" Jul 22 17:35:54.235594 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:35:54.235581 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" path="/var/lib/kubelet/pods/86e83a70-dbf0-4e56-8fa0-c8fda82b4605/volumes" Jul 22 17:46:53.433019 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.432944 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-whdwt/must-gather-rszxw"] Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433215 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a831e09f-7c80-4293-8e6f-34080e5ffaba" containerName="redis" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433226 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a831e09f-7c80-4293-8e6f-34080e5ffaba" containerName="redis" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433235 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="feast-init" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433241 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="feast-init" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433247 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="online" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433254 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="online" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433262 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="registry" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433267 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="registry" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433277 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="feast-init" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433283 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="feast-init" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433289 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="registry" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433294 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="registry" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433302 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="feast-apply" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433307 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="feast-apply" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433312 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="online" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433317 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="online" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433325 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="feast-apply" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433329 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="feast-apply" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433369 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="registry" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433377 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="86e83a70-dbf0-4e56-8fa0-c8fda82b4605" containerName="online" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433383 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a831e09f-7c80-4293-8e6f-34080e5ffaba" containerName="redis" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433390 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="online" Jul 22 17:46:53.433465 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.433397 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e235a63-d50c-44a0-b047-e4ad51283699" containerName="registry" Jul 22 17:46:53.436246 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.436230 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-whdwt/must-gather-rszxw" Jul 22 17:46:53.438558 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.438527 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-whdwt\"/\"default-dockercfg-mtb86\"" Jul 22 17:46:53.438829 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.438744 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-whdwt\"/\"kube-root-ca.crt\"" Jul 22 17:46:53.438931 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.438888 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-whdwt\"/\"openshift-service-ca.crt\"" Jul 22 17:46:53.445976 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.445938 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-whdwt/must-gather-rszxw"] Jul 22 17:46:53.496996 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.496956 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z97cb\" (UniqueName: \"kubernetes.io/projected/a8ae91a5-7a52-4f8c-a97b-d00b44e0ae09-kube-api-access-z97cb\") pod \"must-gather-rszxw\" (UID: \"a8ae91a5-7a52-4f8c-a97b-d00b44e0ae09\") " pod="openshift-must-gather-whdwt/must-gather-rszxw" Jul 22 17:46:53.497165 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.497005 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a8ae91a5-7a52-4f8c-a97b-d00b44e0ae09-must-gather-output\") pod \"must-gather-rszxw\" (UID: \"a8ae91a5-7a52-4f8c-a97b-d00b44e0ae09\") " pod="openshift-must-gather-whdwt/must-gather-rszxw" Jul 22 17:46:53.597827 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.597788 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z97cb\" (UniqueName: \"kubernetes.io/projected/a8ae91a5-7a52-4f8c-a97b-d00b44e0ae09-kube-api-access-z97cb\") pod \"must-gather-rszxw\" (UID: \"a8ae91a5-7a52-4f8c-a97b-d00b44e0ae09\") " pod="openshift-must-gather-whdwt/must-gather-rszxw" Jul 22 17:46:53.597827 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.597835 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a8ae91a5-7a52-4f8c-a97b-d00b44e0ae09-must-gather-output\") pod \"must-gather-rszxw\" (UID: \"a8ae91a5-7a52-4f8c-a97b-d00b44e0ae09\") " pod="openshift-must-gather-whdwt/must-gather-rszxw" Jul 22 17:46:53.598113 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.598099 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a8ae91a5-7a52-4f8c-a97b-d00b44e0ae09-must-gather-output\") pod \"must-gather-rszxw\" (UID: \"a8ae91a5-7a52-4f8c-a97b-d00b44e0ae09\") " pod="openshift-must-gather-whdwt/must-gather-rszxw" Jul 22 17:46:53.606105 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.606076 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z97cb\" (UniqueName: \"kubernetes.io/projected/a8ae91a5-7a52-4f8c-a97b-d00b44e0ae09-kube-api-access-z97cb\") pod \"must-gather-rszxw\" (UID: \"a8ae91a5-7a52-4f8c-a97b-d00b44e0ae09\") " pod="openshift-must-gather-whdwt/must-gather-rszxw" Jul 22 17:46:53.758013 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.757924 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-whdwt/must-gather-rszxw" Jul 22 17:46:53.883131 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.883099 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-whdwt/must-gather-rszxw"] Jul 22 17:46:53.886547 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:46:53.886521 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8ae91a5_7a52_4f8c_a97b_d00b44e0ae09.slice/crio-db49a567f956d5f1087f3beb0d54faef2cf896ebff157b4121bef20a73eb1474 WatchSource:0}: Error finding container db49a567f956d5f1087f3beb0d54faef2cf896ebff157b4121bef20a73eb1474: Status 404 returned error can't find the container with id db49a567f956d5f1087f3beb0d54faef2cf896ebff157b4121bef20a73eb1474 Jul 22 17:46:53.888872 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:53.888857 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 17:46:54.242507 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:54.242474 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whdwt/must-gather-rszxw" event={"ID":"a8ae91a5-7a52-4f8c-a97b-d00b44e0ae09","Type":"ContainerStarted","Data":"db49a567f956d5f1087f3beb0d54faef2cf896ebff157b4121bef20a73eb1474"} Jul 22 17:46:55.249783 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:55.249722 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whdwt/must-gather-rszxw" event={"ID":"a8ae91a5-7a52-4f8c-a97b-d00b44e0ae09","Type":"ContainerStarted","Data":"8db8f8f2d6331ef18481f5db329f9a7649148589ce5840fe81d607ed2a94831c"} Jul 22 17:46:55.250306 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:55.249801 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whdwt/must-gather-rszxw" event={"ID":"a8ae91a5-7a52-4f8c-a97b-d00b44e0ae09","Type":"ContainerStarted","Data":"7d079d5d5d5c1cef00a110011e05f3b41cdd9a92cf5da12c35b388f1ab26b565"} Jul 22 17:46:55.265606 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:55.265554 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-whdwt/must-gather-rszxw" podStartSLOduration=1.478140525 podStartE2EDuration="2.265536812s" totalImagesPullingTime="787.396287ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:46:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:46:55.264537413 +0000 UTC m=+1795.676263045" watchObservedRunningTime="2026-07-22 17:46:55.265536812 +0000 UTC m=+1795.677262421" Jul 22 17:46:56.031072 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:56.031016 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fgld8_b241b6ee-11fc-44f8-b76d-2b13f6aafc5f/global-pull-secret-syncer/0.log" Jul 22 17:46:56.188132 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:56.188099 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tw7zl_32af3d99-28ae-4480-ad7d-7624cc5a7fb9/konnectivity-agent/0.log" Jul 22 17:46:56.291887 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:46:56.291815 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-124.ec2.internal_cc9037de91dc537647b9816f92071cc8/haproxy/0.log" Jul 22 17:47:00.082868 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.082839 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7944974dc6-n7d5m_5af19be2-849c-44a3-9a9e-65b1d009db02/metrics-server/0.log" Jul 22 17:47:00.158530 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.158490 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8km9n_836bd8bb-0686-4a73-98e8-96fae123288d/node-exporter/0.log" Jul 22 17:47:00.186788 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.186743 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8km9n_836bd8bb-0686-4a73-98e8-96fae123288d/kube-rbac-proxy/0.log" Jul 22 17:47:00.211226 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.211188 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8km9n_836bd8bb-0686-4a73-98e8-96fae123288d/init-textfile/0.log" Jul 22 17:47:00.389958 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.389927 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-cwmpx_76986bfe-f808-4481-8883-5167f73667f3/kube-rbac-proxy-main/0.log" Jul 22 17:47:00.412097 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.412064 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-cwmpx_76986bfe-f808-4481-8883-5167f73667f3/kube-rbac-proxy-self/0.log" Jul 22 17:47:00.439449 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.439402 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-cwmpx_76986bfe-f808-4481-8883-5167f73667f3/openshift-state-metrics/0.log" Jul 22 17:47:00.484030 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.484002 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3830e3ff-c629-47c5-af7f-2c58415f5baf/prometheus/0.log" Jul 22 17:47:00.504464 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.504435 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3830e3ff-c629-47c5-af7f-2c58415f5baf/config-reloader/0.log" Jul 22 17:47:00.524663 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.524635 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3830e3ff-c629-47c5-af7f-2c58415f5baf/thanos-sidecar/0.log" Jul 22 17:47:00.547387 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.547358 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3830e3ff-c629-47c5-af7f-2c58415f5baf/kube-rbac-proxy-web/0.log" Jul 22 17:47:00.578816 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.578781 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3830e3ff-c629-47c5-af7f-2c58415f5baf/kube-rbac-proxy/0.log" Jul 22 17:47:00.603363 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.603334 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3830e3ff-c629-47c5-af7f-2c58415f5baf/kube-rbac-proxy-thanos/0.log" Jul 22 17:47:00.625971 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.625933 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3830e3ff-c629-47c5-af7f-2c58415f5baf/init-config-reloader/0.log" Jul 22 17:47:00.741178 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.741102 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56895fb4fb-472jd_56c6e577-9823-4055-9799-0dbb1a6d2448/telemeter-client/0.log" Jul 22 17:47:00.761080 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.761053 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56895fb4fb-472jd_56c6e577-9823-4055-9799-0dbb1a6d2448/reload/0.log" Jul 22 17:47:00.781400 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.781349 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56895fb4fb-472jd_56c6e577-9823-4055-9799-0dbb1a6d2448/kube-rbac-proxy/0.log" Jul 22 17:47:00.827137 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.827088 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcbc884dc-dbf59_72a999a7-bc35-4e29-9d9b-3a5b51482c17/thanos-query/0.log" Jul 22 17:47:00.846342 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.846281 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcbc884dc-dbf59_72a999a7-bc35-4e29-9d9b-3a5b51482c17/kube-rbac-proxy-web/0.log" Jul 22 17:47:00.872513 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.872472 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcbc884dc-dbf59_72a999a7-bc35-4e29-9d9b-3a5b51482c17/kube-rbac-proxy/0.log" Jul 22 17:47:00.895747 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.895715 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcbc884dc-dbf59_72a999a7-bc35-4e29-9d9b-3a5b51482c17/prom-label-proxy/0.log" Jul 22 17:47:00.915663 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.915627 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcbc884dc-dbf59_72a999a7-bc35-4e29-9d9b-3a5b51482c17/kube-rbac-proxy-rules/0.log" Jul 22 17:47:00.940980 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:00.936475 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcbc884dc-dbf59_72a999a7-bc35-4e29-9d9b-3a5b51482c17/kube-rbac-proxy-metrics/0.log" Jul 22 17:47:03.856259 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:03.856219 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8"] Jul 22 17:47:03.861978 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:03.861949 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:03.870841 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:03.870814 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8"] Jul 22 17:47:03.898041 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:03.896749 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8156f1e8-a29f-4a87-a0db-d5d29958302f-proc\") pod \"perf-node-gather-daemonset-x9vn8\" (UID: \"8156f1e8-a29f-4a87-a0db-d5d29958302f\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:03.898041 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:03.896915 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8156f1e8-a29f-4a87-a0db-d5d29958302f-sys\") pod \"perf-node-gather-daemonset-x9vn8\" (UID: \"8156f1e8-a29f-4a87-a0db-d5d29958302f\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:03.898041 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:03.896974 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9h8r\" (UniqueName: \"kubernetes.io/projected/8156f1e8-a29f-4a87-a0db-d5d29958302f-kube-api-access-m9h8r\") pod \"perf-node-gather-daemonset-x9vn8\" (UID: \"8156f1e8-a29f-4a87-a0db-d5d29958302f\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:03.898041 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:03.897007 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8156f1e8-a29f-4a87-a0db-d5d29958302f-lib-modules\") pod \"perf-node-gather-daemonset-x9vn8\" (UID: \"8156f1e8-a29f-4a87-a0db-d5d29958302f\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:03.898041 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:03.897032 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8156f1e8-a29f-4a87-a0db-d5d29958302f-podres\") pod \"perf-node-gather-daemonset-x9vn8\" (UID: \"8156f1e8-a29f-4a87-a0db-d5d29958302f\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:03.997645 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:03.997606 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8156f1e8-a29f-4a87-a0db-d5d29958302f-sys\") pod \"perf-node-gather-daemonset-x9vn8\" (UID: \"8156f1e8-a29f-4a87-a0db-d5d29958302f\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:03.997867 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:03.997659 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9h8r\" (UniqueName: \"kubernetes.io/projected/8156f1e8-a29f-4a87-a0db-d5d29958302f-kube-api-access-m9h8r\") pod \"perf-node-gather-daemonset-x9vn8\" (UID: \"8156f1e8-a29f-4a87-a0db-d5d29958302f\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:03.997867 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:03.997722 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8156f1e8-a29f-4a87-a0db-d5d29958302f-sys\") pod \"perf-node-gather-daemonset-x9vn8\" (UID: \"8156f1e8-a29f-4a87-a0db-d5d29958302f\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:03.997867 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:03.997785 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8156f1e8-a29f-4a87-a0db-d5d29958302f-lib-modules\") pod \"perf-node-gather-daemonset-x9vn8\" (UID: \"8156f1e8-a29f-4a87-a0db-d5d29958302f\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:03.997867 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:03.997809 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8156f1e8-a29f-4a87-a0db-d5d29958302f-podres\") pod \"perf-node-gather-daemonset-x9vn8\" (UID: \"8156f1e8-a29f-4a87-a0db-d5d29958302f\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:03.997867 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:03.997865 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8156f1e8-a29f-4a87-a0db-d5d29958302f-proc\") pod \"perf-node-gather-daemonset-x9vn8\" (UID: \"8156f1e8-a29f-4a87-a0db-d5d29958302f\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:03.998152 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:03.997957 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8156f1e8-a29f-4a87-a0db-d5d29958302f-lib-modules\") pod \"perf-node-gather-daemonset-x9vn8\" (UID: \"8156f1e8-a29f-4a87-a0db-d5d29958302f\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:03.998152 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:03.997974 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8156f1e8-a29f-4a87-a0db-d5d29958302f-proc\") pod \"perf-node-gather-daemonset-x9vn8\" (UID: \"8156f1e8-a29f-4a87-a0db-d5d29958302f\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:03.998152 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:03.998000 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8156f1e8-a29f-4a87-a0db-d5d29958302f-podres\") pod \"perf-node-gather-daemonset-x9vn8\" (UID: \"8156f1e8-a29f-4a87-a0db-d5d29958302f\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:04.005600 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:04.005565 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9h8r\" (UniqueName: \"kubernetes.io/projected/8156f1e8-a29f-4a87-a0db-d5d29958302f-kube-api-access-m9h8r\") pod \"perf-node-gather-daemonset-x9vn8\" (UID: \"8156f1e8-a29f-4a87-a0db-d5d29958302f\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:04.174153 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:04.174058 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:04.334463 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:04.334425 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8"] Jul 22 17:47:04.337346 ip-10-0-139-124 kubenswrapper[2566]: W0722 17:47:04.337314 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8156f1e8_a29f_4a87_a0db_d5d29958302f.slice/crio-41f54d29cbb30574a7f725c563bbc05141b5a6da169e2a5d3e83750357d848ff WatchSource:0}: Error finding container 41f54d29cbb30574a7f725c563bbc05141b5a6da169e2a5d3e83750357d848ff: Status 404 returned error can't find the container with id 41f54d29cbb30574a7f725c563bbc05141b5a6da169e2a5d3e83750357d848ff Jul 22 17:47:04.597163 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:04.597134 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g4n2l_8895870b-2261-4c6f-9dea-1adb67052122/dns/0.log" Jul 22 17:47:04.616612 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:04.616577 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g4n2l_8895870b-2261-4c6f-9dea-1adb67052122/kube-rbac-proxy/0.log" Jul 22 17:47:04.683826 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:04.683785 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-587tp_91bacea2-43c5-4d3f-b292-63732cb9c498/dns-node-resolver/0.log" Jul 22 17:47:05.200404 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:05.200379 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nflq6_79f5b8ea-b241-49ca-9b98-d0d6ea65ede7/node-ca/0.log" Jul 22 17:47:05.297178 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:05.297140 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" event={"ID":"8156f1e8-a29f-4a87-a0db-d5d29958302f","Type":"ContainerStarted","Data":"70d3c486a99b4bf98ffa27c682d8cb644865418cffc073c5e1c9e8bada0f688c"} Jul 22 17:47:05.297343 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:05.297203 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" event={"ID":"8156f1e8-a29f-4a87-a0db-d5d29958302f","Type":"ContainerStarted","Data":"41f54d29cbb30574a7f725c563bbc05141b5a6da169e2a5d3e83750357d848ff"} Jul 22 17:47:05.297343 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:05.297273 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:05.312559 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:05.312510 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" podStartSLOduration=2.31249473 podStartE2EDuration="2.31249473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:47:05.311277541 +0000 UTC m=+1805.723003151" watchObservedRunningTime="2026-07-22 17:47:05.31249473 +0000 UTC m=+1805.724220705" Jul 22 17:47:06.239924 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:06.239897 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hq6br_fe005f0e-8f82-4f6e-a7d6-22df7ae6c4df/serve-healthcheck-canary/0.log" Jul 22 17:47:06.591697 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:06.591666 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hdsp4_f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa/kube-rbac-proxy/0.log" Jul 22 17:47:06.611373 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:06.611348 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hdsp4_f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa/exporter/0.log" Jul 22 17:47:06.632123 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:06.632096 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hdsp4_f59c6b9a-08a0-4772-9bf8-c5f5851cd8aa/extractor/0.log" Jul 22 17:47:11.311183 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:11.311156 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-x9vn8" Jul 22 17:47:12.375959 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:12.375924 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvndg_0d2607d6-99cd-4939-b6fd-258d6cbbda24/kube-multus-additional-cni-plugins/0.log" Jul 22 17:47:12.395439 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:12.395408 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvndg_0d2607d6-99cd-4939-b6fd-258d6cbbda24/egress-router-binary-copy/0.log" Jul 22 17:47:12.418330 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:12.418302 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvndg_0d2607d6-99cd-4939-b6fd-258d6cbbda24/cni-plugins/0.log" Jul 22 17:47:12.441175 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:12.441151 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvndg_0d2607d6-99cd-4939-b6fd-258d6cbbda24/bond-cni-plugin/0.log" Jul 22 17:47:12.461211 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:12.461189 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvndg_0d2607d6-99cd-4939-b6fd-258d6cbbda24/routeoverride-cni/0.log" Jul 22 17:47:12.482528 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:12.482464 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvndg_0d2607d6-99cd-4939-b6fd-258d6cbbda24/whereabouts-cni-bincopy/0.log" Jul 22 17:47:12.504910 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:12.504886 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvndg_0d2607d6-99cd-4939-b6fd-258d6cbbda24/whereabouts-cni/0.log" Jul 22 17:47:12.718930 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:12.718902 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jbb87_e548aa5c-72ec-4683-8c6e-134af82566e7/kube-multus/0.log" Jul 22 17:47:12.780235 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:12.780152 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-frsjr_0e3de27a-4391-4543-a2c7-1eea25076ccb/network-metrics-daemon/0.log" Jul 22 17:47:12.798633 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:12.798602 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-frsjr_0e3de27a-4391-4543-a2c7-1eea25076ccb/kube-rbac-proxy/0.log" Jul 22 17:47:13.694218 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:13.694190 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5lb4_340b976d-2ce2-4ba2-962e-37418239857a/ovn-controller/0.log" Jul 22 17:47:13.711061 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:13.711033 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5lb4_340b976d-2ce2-4ba2-962e-37418239857a/ovn-acl-logging/0.log" Jul 22 17:47:13.731423 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:13.731380 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5lb4_340b976d-2ce2-4ba2-962e-37418239857a/kube-rbac-proxy-node/0.log" Jul 22 17:47:13.749915 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:13.749876 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5lb4_340b976d-2ce2-4ba2-962e-37418239857a/kube-rbac-proxy-ovn-metrics/0.log" Jul 22 17:47:13.767870 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:13.767850 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5lb4_340b976d-2ce2-4ba2-962e-37418239857a/northd/0.log" Jul 22 17:47:13.787816 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:13.787756 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5lb4_340b976d-2ce2-4ba2-962e-37418239857a/nbdb/0.log" Jul 22 17:47:13.807641 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:13.807618 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5lb4_340b976d-2ce2-4ba2-962e-37418239857a/sbdb/0.log" Jul 22 17:47:13.849814 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:13.849743 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5lb4_340b976d-2ce2-4ba2-962e-37418239857a/ovnkube-controller/0.log" Jul 22 17:47:15.316872 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:15.316845 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-xccc6_04b8092a-803b-4ba2-be5a-db6df13a1bcc/network-check-target-container/0.log" Jul 22 17:47:16.215889 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:16.215861 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-x2j49_b78d2c3a-0dbf-43d8-8ff8-a60482ab0ed3/iptables-alerter/0.log" Jul 22 17:47:16.867820 ip-10-0-139-124 kubenswrapper[2566]: I0722 17:47:16.867786 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-vclzk_ba3cdbe0-6b16-4a25-8859-4514a964b597/tuned/0.log"