Jul 21 18:28:32.427671 ip-10-0-136-34 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 21 18:28:32.427680 ip-10-0-136-34 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 21 18:28:32.427687 ip-10-0-136-34 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 21 18:28:32.427947 ip-10-0-136-34 systemd[1]: Failed to start Kubernetes Kubelet. Jul 21 18:28:42.603844 ip-10-0-136-34 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 21 18:28:42.603859 ip-10-0-136-34 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 97ee492557674a25aeedfb9a220f9ba5 -- Jul 21 18:30:36.807158 ip-10-0-136-34 systemd[1]: Starting Kubernetes Kubelet... Jul 21 18:30:38.743350 ip-10-0-136-34 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 18:30:38.743350 ip-10-0-136-34 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 18:30:38.743350 ip-10-0-136-34 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 18:30:38.743350 ip-10-0-136-34 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 18:30:38.743350 ip-10-0-136-34 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 18:30:38.745520 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.745424 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 18:30:38.750772 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750754 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:30:38.750772 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750772 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750776 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750780 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750783 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750786 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750789 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750792 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750801 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750804 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750807 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750812 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750817 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750821 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750824 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750827 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750830 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750833 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750836 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750839 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750841 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:30:38.750842 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750844 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750847 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750850 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750854 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750857 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750860 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750863 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750866 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750869 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750871 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750874 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750877 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750879 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750882 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750885 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750888 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750890 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750894 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750904 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750908 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:30:38.751374 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750911 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750914 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750931 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750936 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750939 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750942 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750944 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750947 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750951 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750954 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750957 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750959 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750962 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750965 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750969 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750973 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750976 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750979 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750982 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750986 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:30:38.752211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750990 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750994 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.750997 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751000 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751004 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751007 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751010 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751012 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751015 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751018 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751022 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751025 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751028 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751033 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751037 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751040 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751043 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751046 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751049 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:30:38.753109 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751052 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751055 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751058 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751061 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751065 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751068 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751070 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751073 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751077 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751080 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751083 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751085 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751088 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751091 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751094 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751097 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751100 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751103 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.751106 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752245 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:30:38.753963 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752263 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752269 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752275 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752279 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752284 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752290 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752295 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752299 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752304 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752309 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752314 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752318 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752323 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752327 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752332 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752336 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752343 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752348 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752352 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752357 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:30:38.754910 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752361 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752366 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752370 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752375 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752379 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752384 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752389 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752393 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752398 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752402 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752407 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752412 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752418 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752423 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752427 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752432 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752439 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752446 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752452 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:30:38.755802 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752457 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752461 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752465 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752470 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752474 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752479 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752484 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752488 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752493 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752497 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752502 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752507 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752511 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752515 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752520 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752525 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752532 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752536 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752540 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752545 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:30:38.756375 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752549 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752554 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752559 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752564 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752568 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752573 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752579 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752584 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752588 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752593 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752599 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752604 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752611 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752620 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752625 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752630 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752634 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752639 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752643 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:30:38.756995 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752648 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752653 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752657 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752662 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752666 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752671 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752675 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752680 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752684 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752689 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752694 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752698 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752702 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752707 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752712 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752717 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752721 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752726 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752731 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.752735 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:30:38.757683 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753414 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753424 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753429 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753434 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753438 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753443 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753447 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753452 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753456 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753461 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753465 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753470 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753474 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753479 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753484 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753488 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753493 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753497 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753502 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753506 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:30:38.758308 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753511 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753515 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753520 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753525 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753529 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753534 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753538 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753543 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753548 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753553 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753559 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753564 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753570 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753575 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753579 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753584 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753589 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753593 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753599 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753604 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:30:38.758848 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753609 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753613 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753618 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753622 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753627 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753632 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753637 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753642 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753647 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753651 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753656 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753661 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753665 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753672 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753678 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753683 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753688 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753693 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753697 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753702 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:30:38.759793 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753707 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753712 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753717 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753722 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753728 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753733 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753738 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753743 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753747 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753752 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753759 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753765 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753770 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753775 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753779 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753783 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753788 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753793 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753797 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:30:38.760344 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753802 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753806 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753810 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753814 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753819 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753823 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753828 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753833 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753837 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753842 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753846 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753851 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753856 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753862 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753868 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753873 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753878 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753882 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753887 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.753892 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:30:38.760878 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754030 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754043 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754055 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754063 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754070 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754075 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754082 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754090 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754095 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754101 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754107 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754113 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754118 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754123 2556 flags.go:64] FLAG: --cgroup-root="" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754128 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754133 2556 flags.go:64] FLAG: --client-ca-file="" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754141 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754147 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754155 2556 flags.go:64] FLAG: --cluster-domain="" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754161 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754166 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754172 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754178 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754184 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 18:30:38.761416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754190 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754196 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754202 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754207 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754213 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754218 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754224 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754228 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754237 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754242 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754247 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754253 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754258 2556 flags.go:64] FLAG: --enable-server="true" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754263 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754271 2556 flags.go:64] FLAG: --event-burst="100" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754276 2556 flags.go:64] FLAG: --event-qps="50" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754282 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754290 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754295 2556 flags.go:64] FLAG: --eviction-hard="" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754302 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754307 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754312 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754318 2556 flags.go:64] FLAG: --eviction-soft="" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754323 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754328 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 18:30:38.762076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754334 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754339 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754344 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754349 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754354 2556 flags.go:64] FLAG: --feature-gates="" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754361 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754367 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754373 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754379 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754385 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754390 2556 flags.go:64] FLAG: --help="false" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754395 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-136-34.ec2.internal" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754401 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754407 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754412 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754418 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754425 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754430 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754435 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754440 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754445 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754451 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754457 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754462 2556 flags.go:64] FLAG: --kube-reserved="" Jul 21 18:30:38.762717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754469 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754474 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754479 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754484 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754489 2556 flags.go:64] FLAG: --lock-file="" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754494 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754499 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754504 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754514 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754520 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754525 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754529 2556 flags.go:64] FLAG: --logging-format="text" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754534 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754540 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754548 2556 flags.go:64] FLAG: --manifest-url="" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754553 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754560 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754566 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754573 2556 flags.go:64] FLAG: --max-pods="110" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754578 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754583 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754589 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754594 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754599 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754605 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 18:30:38.763350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754611 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754623 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754629 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754634 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754639 2556 flags.go:64] FLAG: --pod-cidr="" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754644 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754653 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754659 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754665 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754670 2556 flags.go:64] FLAG: --port="10250" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754675 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754680 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0741f936ec2476ddb" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754686 2556 flags.go:64] FLAG: --qos-reserved="" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754691 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754696 2556 flags.go:64] FLAG: --register-node="true" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754701 2556 flags.go:64] FLAG: --register-with-taints="" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754708 2556 flags.go:64] FLAG: --registry-burst="10" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754714 2556 flags.go:64] FLAG: --registry-qps="5" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754718 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754723 2556 flags.go:64] FLAG: --reserved-memory="" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754754 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754762 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754770 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754775 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754780 2556 flags.go:64] FLAG: --runonce="false" Jul 21 18:30:38.764036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754785 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754791 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754796 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754802 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754807 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754812 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754818 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754823 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754829 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754834 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754840 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754845 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754850 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754855 2556 flags.go:64] FLAG: --system-cgroups="" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754862 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754872 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754877 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754882 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754889 2556 flags.go:64] FLAG: --tls-min-version="" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754895 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754900 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754905 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754910 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754915 2556 flags.go:64] FLAG: --v="2" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754949 2556 flags.go:64] FLAG: --version="false" Jul 21 18:30:38.764706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754957 2556 flags.go:64] FLAG: --vmodule="" Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754964 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.754970 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755177 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755189 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755194 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755199 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755204 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755208 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755212 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755217 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755221 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755226 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755239 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755244 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755248 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755254 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755258 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755263 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755268 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:30:38.765377 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755272 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755279 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755284 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755289 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755293 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755298 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755303 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755307 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755312 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755316 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755321 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755326 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755330 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755335 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755340 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755344 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755350 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755355 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755359 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755364 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:30:38.765917 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755369 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755373 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755378 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755382 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755387 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755392 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755396 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755400 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755405 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755410 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755415 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755420 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755424 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755431 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755435 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755440 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755444 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755449 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755453 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:30:38.766756 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755458 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755463 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755467 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755472 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755476 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755481 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755485 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755489 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755494 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755500 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755504 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755511 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755517 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755522 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755526 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755534 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755540 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755545 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755550 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:30:38.767521 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755555 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755560 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755565 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755570 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755576 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755581 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755585 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755592 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755596 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755601 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755605 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755610 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755615 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755620 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755624 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755631 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755637 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755642 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755646 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755651 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:30:38.768037 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755656 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:30:38.768723 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755662 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:30:38.768723 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755669 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:30:38.768723 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.755675 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:30:38.768723 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.756285 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 18:30:38.768723 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.763781 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 18:30:38.768723 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.763799 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 18:30:38.768723 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.764762 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 18:30:38.768723 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.764771 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 18:30:38.768723 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764835 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:30:38.768723 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764841 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:30:38.768723 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764845 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:30:38.768723 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764848 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:30:38.768723 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764851 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:30:38.768723 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764855 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:30:38.768723 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764858 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764863 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764866 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764869 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764872 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764875 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764877 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764880 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764883 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764886 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764889 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764892 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764895 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764897 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764900 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764903 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764906 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764908 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764911 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764914 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:30:38.769416 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764917 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764934 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764937 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764941 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764945 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764948 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764952 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764956 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764959 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764962 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764965 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764968 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764971 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764973 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764977 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764980 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764983 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764986 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764989 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:30:38.770309 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764992 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764995 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.764998 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765000 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765003 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765006 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765009 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765012 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765014 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765017 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765020 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765022 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765025 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765029 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765032 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765034 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765038 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765041 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765044 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765047 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:30:38.770837 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765050 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765052 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765056 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765058 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765061 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765064 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765067 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765070 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765073 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765076 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765079 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765082 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765085 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765089 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765093 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765096 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765099 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765103 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765107 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:30:38.771544 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765110 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:30:38.772162 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765113 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:30:38.772162 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765116 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:30:38.772162 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765119 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:30:38.772162 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765122 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:30:38.772162 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765125 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:30:38.772162 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765128 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:30:38.772162 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765130 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:30:38.772162 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765133 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:30:38.772162 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765137 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:30:38.772162 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765140 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:30:38.772162 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765143 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:30:38.772162 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765145 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:30:38.772162 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765148 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:30:38.772162 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765151 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:30:38.772162 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.765156 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765280 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765285 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765288 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765291 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765294 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765297 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765301 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765303 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765306 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765309 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765312 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765315 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765318 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765320 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765323 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765326 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765329 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765332 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765335 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:30:38.772579 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765337 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765340 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765343 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765345 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765348 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765351 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765354 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765357 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765360 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765363 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765366 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765368 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765371 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765374 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765378 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765382 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765385 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765389 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765392 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:30:38.773211 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765395 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765399 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765402 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765404 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765407 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765410 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765414 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765417 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765421 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765423 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765426 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765430 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765433 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765436 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765439 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765442 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765445 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765448 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765451 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765454 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:30:38.773798 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765457 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765460 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765462 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765465 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765468 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765471 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765473 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765476 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765479 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765482 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765484 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765487 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765489 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765492 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765496 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765500 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765503 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765505 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765508 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765511 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:30:38.774395 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765514 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765516 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765519 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765522 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765524 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765527 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765530 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765533 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765536 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765539 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765541 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765545 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765548 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765551 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765553 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765556 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765559 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765561 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765564 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765567 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:30:38.775102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:38.765569 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:30:38.775646 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.765575 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 18:30:38.775646 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.765715 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 18:30:38.775646 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.771016 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 18:30:38.775646 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.772606 2556 server.go:1019] "Starting client certificate rotation" Jul 21 18:30:38.775646 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.772723 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 18:30:38.775646 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.772756 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 18:30:38.776155 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.776137 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 18:30:38.777463 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.777441 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 18:30:38.784700 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.784682 2556 log.go:25] "Validated CRI v1 runtime API" Jul 21 18:30:38.786846 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.786831 2556 log.go:25] "Validated CRI v1 image API" Jul 21 18:30:38.787689 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.787675 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 18:30:38.790603 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.790583 2556 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 82902f5e-fbd3-4f8d-9d0e-729c97efa6fb:/dev/nvme0n1p3 a5ec27d2-3ac5-449d-aa3e-99d61b14f4da:/dev/nvme0n1p4] Jul 21 18:30:38.790668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.790603 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 18:30:38.797085 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.796965 2556 manager.go:216] Machine: {Timestamp:2026-07-21 18:30:38.795611785 +0000 UTC m=+1.857691387 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098635 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f4728571926a4decdbae2e1ed50bf SystemUUID:ec2f4728-5719-26a4-decd-bae2e1ed50bf BootID:97ee4925-5767-4a25-aeed-fb9a220f9ba5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:da:fd:3f:1c:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:da:fd:3f:1c:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:d2:52:ee:0e:10 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 18:30:38.797085 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.797080 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 18:30:38.797193 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.797165 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 18:30:38.800741 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.800710 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 18:30:38.801020 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.800746 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-34.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 18:30:38.802177 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.801747 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 18:30:38.802177 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.801777 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 18:30:38.802177 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.801789 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 18:30:38.804250 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.804040 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 18:30:38.805607 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.805594 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 18:30:38.806263 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.806242 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 18:30:38.808821 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.808808 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 21 18:30:38.808963 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.808953 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 18:30:38.809000 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.808989 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 21 18:30:38.809029 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.809002 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 18:30:38.809029 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.809015 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 18:30:38.809029 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.809025 2556 kubelet.go:398] "Adding apiserver pod source" Jul 21 18:30:38.809134 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.809034 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 18:30:38.809442 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.809428 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 18:30:38.809497 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.809449 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 18:30:38.811826 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.811808 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 18:30:38.813306 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.813289 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 18:30:38.813387 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.813330 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 18:30:38.814043 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.814028 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 18:30:38.814122 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.814049 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 18:30:38.814122 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.814059 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 18:30:38.814122 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.814068 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 18:30:38.814122 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.814080 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 18:30:38.814122 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.814090 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 18:30:38.814122 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.814118 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 18:30:38.814328 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.814127 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 18:30:38.814328 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.814138 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 18:30:38.814328 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.814147 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 18:30:38.814328 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.814161 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 18:30:38.814328 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.814174 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 18:30:38.815108 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.815096 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 18:30:38.815168 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.815111 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 18:30:38.818543 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.818527 2556 server.go:1268] "Started kubelet" Jul 21 18:30:38.818634 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.818587 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 18:30:38.818741 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.818685 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 18:30:38.818794 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.818768 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 18:30:38.819457 ip-10-0-136-34 systemd[1]: Started Kubernetes Kubelet. Jul 21 18:30:38.820176 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.820048 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 18:30:38.820422 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.820405 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-34.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 18:30:38.821079 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:38.821050 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-34.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 18:30:38.821079 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:38.821053 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 18:30:38.821233 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.821156 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 21 18:30:38.824783 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:38.824761 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 18:30:38.827621 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:38.826668 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-34.ec2.internal.18c46193941bd45f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-34.ec2.internal,UID:ip-10-0-136-34.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-34.ec2.internal,},FirstTimestamp:2026-07-21 18:30:38.818497631 +0000 UTC m=+1.880577233,LastTimestamp:2026-07-21 18:30:38.818497631 +0000 UTC m=+1.880577233,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-34.ec2.internal,}" Jul 21 18:30:38.828001 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.827986 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 18:30:38.828074 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.828008 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 18:30:38.828172 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:38.828144 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-34.ec2.internal\" not found" Jul 21 18:30:38.828911 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.828890 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 18:30:38.829003 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.828896 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 18:30:38.829003 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.828932 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 18:30:38.829105 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.829050 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 21 18:30:38.829105 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.829060 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 21 18:30:38.829632 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.829614 2556 factory.go:153] Registering CRI-O factory Jul 21 18:30:38.829728 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.829636 2556 factory.go:223] Registration of the crio container factory successfully Jul 21 18:30:38.829728 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.829690 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 18:30:38.829728 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.829698 2556 factory.go:55] Registering systemd factory Jul 21 18:30:38.829728 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.829704 2556 factory.go:223] Registration of the systemd container factory successfully Jul 21 18:30:38.829728 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.829723 2556 factory.go:103] Registering Raw factory Jul 21 18:30:38.829977 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.829737 2556 manager.go:1196] Started watching for new ooms in manager Jul 21 18:30:38.830326 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.830169 2556 manager.go:349] Starting recovery of all containers Jul 21 18:30:38.831965 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.831938 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8hjxt" Jul 21 18:30:38.834895 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:38.834864 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-34.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 21 18:30:38.835052 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:38.835023 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 21 18:30:38.840415 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.840394 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8hjxt" Jul 21 18:30:38.843543 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.843525 2556 manager.go:354] Recovery completed Jul 21 18:30:38.848122 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.848106 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:30:38.850057 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.850041 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:30:38.850130 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.850068 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:30:38.850130 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.850079 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:30:38.851333 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.851076 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 18:30:38.851333 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.851092 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 18:30:38.851333 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.851111 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 21 18:30:38.851333 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.851120 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:30:38.852100 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:38.852030 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-34.ec2.internal.18c4619395fd635a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-34.ec2.internal,UID:ip-10-0-136-34.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-34.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-34.ec2.internal,},FirstTimestamp:2026-07-21 18:30:38.85005705 +0000 UTC m=+1.912136652,LastTimestamp:2026-07-21 18:30:38.85005705 +0000 UTC m=+1.912136652,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-34.ec2.internal,}" Jul 21 18:30:38.852494 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.852478 2556 policy_none.go:49] "None policy: Start" Jul 21 18:30:38.852579 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.852498 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 18:30:38.852579 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.852510 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 18:30:38.853398 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.853367 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:30:38.853398 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.853398 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:30:38.853543 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.853410 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:30:38.853671 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.853654 2556 policy_none.go:47] "Start" Jul 21 18:30:38.886663 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.886505 2556 manager.go:337] "Starting Device Plugin manager" Jul 21 18:30:38.886782 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:38.886694 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 18:30:38.886782 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.886709 2556 server.go:87] "Starting device plugin registration server" Jul 21 18:30:38.886974 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.886962 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 18:30:38.887010 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.886976 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 18:30:38.887191 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.887174 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 18:30:38.887296 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.887266 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 18:30:38.887296 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.887282 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 18:30:38.887870 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:38.887781 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 18:30:38.887870 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:38.887842 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-34.ec2.internal\" not found" Jul 21 18:30:38.973694 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.973646 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 18:30:38.974949 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.974916 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 18:30:38.975015 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.974976 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 18:30:38.975015 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.975005 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 18:30:38.975098 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:38.975050 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 18:30:38.977682 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.977661 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 18:30:38.987298 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.987280 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:30:38.988133 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.988118 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:30:38.988212 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.988150 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:30:38.988212 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.988167 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:30:38.988212 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.988198 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-34.ec2.internal" Jul 21 18:30:38.995095 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:38.995079 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-34.ec2.internal" Jul 21 18:30:38.995172 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:38.995102 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-34.ec2.internal\": node \"ip-10-0-136-34.ec2.internal\" not found" Jul 21 18:30:39.014423 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:39.014392 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-34.ec2.internal\" not found" Jul 21 18:30:39.075289 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.075195 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-34.ec2.internal"] Jul 21 18:30:39.075289 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.075279 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:30:39.076312 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.076290 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:30:39.076381 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.076319 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:30:39.076381 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.076330 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:30:39.077993 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.077981 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:30:39.078141 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.078126 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal" Jul 21 18:30:39.078191 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.078160 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:30:39.078801 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.078781 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:30:39.078801 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.078790 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:30:39.078801 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.078804 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:30:39.079014 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.078813 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:30:39.079014 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.078818 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:30:39.079014 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.078824 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:30:39.080033 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.080016 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-34.ec2.internal" Jul 21 18:30:39.080124 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.080042 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:30:39.080737 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.080721 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:30:39.080737 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.080746 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:30:39.080881 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.080760 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:30:39.101622 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:39.101606 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-34.ec2.internal\" not found" node="ip-10-0-136-34.ec2.internal" Jul 21 18:30:39.106218 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:39.106203 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-34.ec2.internal\" not found" node="ip-10-0-136-34.ec2.internal" Jul 21 18:30:39.115103 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:39.115086 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-34.ec2.internal\" not found" Jul 21 18:30:39.215170 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:39.215140 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-34.ec2.internal\" not found" Jul 21 18:30:39.229853 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.229826 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6c90ef6bbcb79b45f9b031a1263361d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal\" (UID: \"d6c90ef6bbcb79b45f9b031a1263361d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal" Jul 21 18:30:39.229947 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.229871 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6c90ef6bbcb79b45f9b031a1263361d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal\" (UID: \"d6c90ef6bbcb79b45f9b031a1263361d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal" Jul 21 18:30:39.229947 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.229892 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab365cfc620fcb9efb235526502a3d4a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-34.ec2.internal\" (UID: \"ab365cfc620fcb9efb235526502a3d4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-34.ec2.internal" Jul 21 18:30:39.316039 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:39.315996 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-34.ec2.internal\" not found" Jul 21 18:30:39.330476 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.330410 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6c90ef6bbcb79b45f9b031a1263361d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal\" (UID: \"d6c90ef6bbcb79b45f9b031a1263361d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal" Jul 21 18:30:39.330557 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.330464 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6c90ef6bbcb79b45f9b031a1263361d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal\" (UID: \"d6c90ef6bbcb79b45f9b031a1263361d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal" Jul 21 18:30:39.330557 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.330503 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6c90ef6bbcb79b45f9b031a1263361d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal\" (UID: \"d6c90ef6bbcb79b45f9b031a1263361d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal" Jul 21 18:30:39.330557 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.330510 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab365cfc620fcb9efb235526502a3d4a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-34.ec2.internal\" (UID: \"ab365cfc620fcb9efb235526502a3d4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-34.ec2.internal" Jul 21 18:30:39.330667 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.330556 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6c90ef6bbcb79b45f9b031a1263361d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal\" (UID: \"d6c90ef6bbcb79b45f9b031a1263361d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal" Jul 21 18:30:39.330667 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.330576 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab365cfc620fcb9efb235526502a3d4a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-34.ec2.internal\" (UID: \"ab365cfc620fcb9efb235526502a3d4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-34.ec2.internal" Jul 21 18:30:39.408555 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.408506 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal" Jul 21 18:30:39.410138 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.410121 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-34.ec2.internal" Jul 21 18:30:39.416544 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:39.416526 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-34.ec2.internal\" not found" Jul 21 18:30:39.519900 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:39.519839 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-34.ec2.internal\" not found" Jul 21 18:30:39.620636 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:39.620553 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-34.ec2.internal\" not found" Jul 21 18:30:39.721513 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:39.721466 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-34.ec2.internal\" not found" Jul 21 18:30:39.773882 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.773833 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 18:30:39.774306 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.774060 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 18:30:39.821558 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:39.821531 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-34.ec2.internal\" not found" Jul 21 18:30:39.845973 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.845919 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 18:25:39 +0000 UTC" deadline="2028-05-01 22:53:02.504378628 +0000 UTC" Jul 21 18:30:39.845973 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.845964 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15604h22m22.658418136s" Jul 21 18:30:39.906090 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.906010 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 18:30:39.928530 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.928499 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-34.ec2.internal" Jul 21 18:30:39.938604 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.938574 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 18:30:39.940573 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.940556 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal" Jul 21 18:30:39.951363 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:39.951340 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 18:30:40.096044 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:40.096003 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab365cfc620fcb9efb235526502a3d4a.slice/crio-f322104fb05ed5839c075856c3a50f96d4bb46d6d902a6fa838ba9868833059d WatchSource:0}: Error finding container f322104fb05ed5839c075856c3a50f96d4bb46d6d902a6fa838ba9868833059d: Status 404 returned error can't find the container with id f322104fb05ed5839c075856c3a50f96d4bb46d6d902a6fa838ba9868833059d Jul 21 18:30:40.096324 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:40.096297 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6c90ef6bbcb79b45f9b031a1263361d.slice/crio-772b2be0500e3cdeab0e985045e7fe52001bec06473dd9bfdeb021916c60991e WatchSource:0}: Error finding container 772b2be0500e3cdeab0e985045e7fe52001bec06473dd9bfdeb021916c60991e: Status 404 returned error can't find the container with id 772b2be0500e3cdeab0e985045e7fe52001bec06473dd9bfdeb021916c60991e Jul 21 18:30:40.103419 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.103395 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 18:30:40.216442 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.216350 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 18:30:40.307567 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.307533 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 18:30:40.788492 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.788458 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 18:30:40.809604 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.809578 2556 apiserver.go:52] "Watching apiserver" Jul 21 18:30:40.817533 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.817508 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 18:30:40.817988 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.817954 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-76v4f","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal","openshift-multus/multus-additional-cni-plugins-mm58k","openshift-multus/multus-d8kt6","openshift-multus/network-metrics-daemon-649bh","kube-system/global-pull-secret-syncer-khz8z","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq","openshift-image-registry/node-ca-272qz","openshift-network-diagnostics/network-check-target-d9kjr","openshift-network-operator/iptables-alerter-q2q92","openshift-ovn-kubernetes/ovnkube-node-49tds","kube-system/konnectivity-agent-p9x2q","kube-system/kube-apiserver-proxy-ip-10-0-136-34.ec2.internal","openshift-cluster-node-tuning-operator/tuned-kql8l"] Jul 21 18:30:40.819399 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.819378 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.820756 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.820729 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.822064 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.822032 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 18:30:40.822189 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.822151 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 18:30:40.822276 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.822252 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.822341 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.822297 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-df7wn\"" Jul 21 18:30:40.822400 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.822366 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 18:30:40.823269 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.823248 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 18:30:40.823489 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.823471 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 18:30:40.823565 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.823519 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 18:30:40.823756 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.823733 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 18:30:40.823816 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.823740 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.823853 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.823832 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 18:30:40.823945 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.823742 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 18:30:40.824635 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.824341 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bb8bv\"" Jul 21 18:30:40.824635 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.824448 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 18:30:40.824635 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.824610 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 18:30:40.824875 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.824811 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 18:30:40.824875 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.824816 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 18:30:40.824875 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.824851 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 18:30:40.825162 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.825143 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rpql9\"" Jul 21 18:30:40.825724 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.825705 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:40.825876 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:40.825840 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:30:40.826368 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.826349 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bhj8f\"" Jul 21 18:30:40.826876 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.826845 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 18:30:40.826968 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.826953 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:40.827035 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:40.827012 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:30:40.828357 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.828335 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 18:30:40.829236 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.828339 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:30:40.829314 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:40.829269 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:30:40.831071 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.830277 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.833079 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.833051 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-272qz" Jul 21 18:30:40.833525 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.833498 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-58vfj\"" Jul 21 18:30:40.834254 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.834102 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 18:30:40.834254 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.834153 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 18:30:40.835472 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.835452 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q2q92" Jul 21 18:30:40.835952 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.835913 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dtxbb\"" Jul 21 18:30:40.836256 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.836237 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 18:30:40.836739 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.836564 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 18:30:40.836739 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.836655 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 18:30:40.837193 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.837156 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-76v4f" Jul 21 18:30:40.838036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.838012 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 18:30:40.838155 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.838138 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b8l8r\"" Jul 21 18:30:40.838246 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.838163 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 18:30:40.838246 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.838186 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 18:30:40.839138 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.839118 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p9x2q" Jul 21 18:30:40.839338 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.839317 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 18:30:40.839777 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.839757 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7nh69\"" Jul 21 18:30:40.839862 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.839815 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 18:30:40.840705 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.840682 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edef5c78-4c08-484b-aec7-d3a3ed263aa7-cni-binary-copy\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.840789 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.840718 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-run-k8s-cni-cncf-io\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.840789 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.840745 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-run\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.840789 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.840768 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-sysctl-d\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.841015 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.840821 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-var-lib-kubelet\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.841015 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.840857 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-log-socket\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.841015 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.840886 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19b651b5-3d20-413a-9bdc-695c0223b53b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.841015 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.840915 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-cnibin\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.841015 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.840984 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-var-lib-cni-bin\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.841015 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841010 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-tuned\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.841314 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841037 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25xnk\" (UniqueName: \"kubernetes.io/projected/e6b1218e-fe6e-494c-ad23-41a05dd07b75-kube-api-access-25xnk\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.841314 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841071 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-etc-selinux\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.841314 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841095 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-socket-dir\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.841314 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841121 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-node-log\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.841314 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841146 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-cni-netd\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.841314 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841174 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19b651b5-3d20-413a-9bdc-695c0223b53b-cnibin\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.841314 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841198 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2szxj\" (UniqueName: \"kubernetes.io/projected/a470140f-489b-4888-b8a9-3602acdd8640-kube-api-access-2szxj\") pod \"network-metrics-daemon-649bh\" (UID: \"a470140f-489b-4888-b8a9-3602acdd8640\") " pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:40.841314 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841232 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-sysctl-conf\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.841314 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841257 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr5kb\" (UniqueName: \"kubernetes.io/projected/5c60db40-aa63-4bc3-8889-81225f113c8a-kube-api-access-rr5kb\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.841314 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841288 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-slash\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.841314 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841315 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19b651b5-3d20-413a-9bdc-695c0223b53b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.841874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841340 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret\") pod \"global-pull-secret-syncer-khz8z\" (UID: \"7089390f-33ca-4e99-bb5c-0899bb33463d\") " pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:40.841874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841365 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edef5c78-4c08-484b-aec7-d3a3ed263aa7-multus-daemon-config\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.841874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841420 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-run-multus-certs\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.841874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841446 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-etc-kubernetes\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.841874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841472 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-kubernetes\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.841874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841508 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-etc-openvswitch\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.841874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841578 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 18:30:40.841874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841579 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-run-ovn-kubernetes\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.841874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841632 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f54565df-771f-43bc-bc59-4b9eb71143e0-ovn-node-metrics-cert\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.841874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841656 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-var-lib-kubelet\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.841874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841685 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-modprobe-d\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.841874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841736 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-lib-modules\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.841874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841781 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6b1218e-fe6e-494c-ad23-41a05dd07b75-tmp\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.841874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841810 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-cni-bin\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.841874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841845 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qpfcz\"" Jul 21 18:30:40.841874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841848 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6spfm\" (UniqueName: \"kubernetes.io/projected/19b651b5-3d20-413a-9bdc-695c0223b53b-kube-api-access-6spfm\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.841874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841874 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7089390f-33ca-4e99-bb5c-0899bb33463d-dbus\") pod \"global-pull-secret-syncer-khz8z\" (UID: \"7089390f-33ca-4e99-bb5c-0899bb33463d\") " pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:40.842668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841897 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-sysconfig\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.842668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841941 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-host\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.842668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.841964 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-registration-dir\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.842668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842007 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.842668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842044 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7089390f-33ca-4e99-bb5c-0899bb33463d-kubelet-config\") pod \"global-pull-secret-syncer-khz8z\" (UID: \"7089390f-33ca-4e99-bb5c-0899bb33463d\") " pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:40.842668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842090 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-multus-socket-dir-parent\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.842668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842121 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-var-lib-cni-multus\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.842668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842152 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 18:30:40.842668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842150 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-device-dir\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.842668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842192 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-run-systemd\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.842668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842215 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-var-lib-openvswitch\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.842668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842239 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-system-cni-dir\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.842668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842269 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs\") pod \"network-metrics-daemon-649bh\" (UID: \"a470140f-489b-4888-b8a9-3602acdd8640\") " pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:40.842668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842301 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-sys\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.842668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842334 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19b651b5-3d20-413a-9bdc-695c0223b53b-system-cni-dir\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.842668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842365 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-hostroot\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.842668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842394 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-multus-conf-dir\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.843450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842422 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-systemd-units\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.843450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842446 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-os-release\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.843450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842469 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-sys-fs\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.843450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842486 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-run-netns\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.843450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842516 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f54565df-771f-43bc-bc59-4b9eb71143e0-env-overrides\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.843450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842545 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqfdz\" (UniqueName: \"kubernetes.io/projected/f54565df-771f-43bc-bc59-4b9eb71143e0-kube-api-access-rqfdz\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.843450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842570 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-systemd\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.843450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842593 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-kubelet\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.843450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842618 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19b651b5-3d20-413a-9bdc-695c0223b53b-cni-binary-copy\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.843450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842643 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19b651b5-3d20-413a-9bdc-695c0223b53b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.843450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842669 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-run-ovn\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.843450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842695 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skmc6\" (UniqueName: \"kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6\") pod \"network-check-target-d9kjr\" (UID: \"287e892d-0539-4cd6-91c9-13035bd0f542\") " pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:30:40.843450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842719 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-run-netns\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.843450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842744 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-run-openvswitch\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.843450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842781 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f54565df-771f-43bc-bc59-4b9eb71143e0-ovnkube-config\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.843450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842815 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2zlj\" (UniqueName: \"kubernetes.io/projected/edef5c78-4c08-484b-aec7-d3a3ed263aa7-kube-api-access-b2zlj\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.844206 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842843 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.844206 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842883 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f54565df-771f-43bc-bc59-4b9eb71143e0-ovnkube-script-lib\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.844206 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842898 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 18:30:40.844206 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842903 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19b651b5-3d20-413a-9bdc-695c0223b53b-os-release\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.844206 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.842940 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-multus-cni-dir\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.868471 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.868447 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cxhdp" Jul 21 18:30:40.879416 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.879391 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cxhdp" Jul 21 18:30:40.930350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.930318 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 18:30:40.943419 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943388 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-log-socket\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.943591 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943428 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19b651b5-3d20-413a-9bdc-695c0223b53b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.943591 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943467 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-cnibin\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.943591 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943512 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-log-socket\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.943591 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943526 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-cnibin\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.943591 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943561 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-var-lib-cni-bin\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.943857 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943589 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-var-lib-cni-bin\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.943857 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943608 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-tuned\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.943857 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943635 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25xnk\" (UniqueName: \"kubernetes.io/projected/e6b1218e-fe6e-494c-ad23-41a05dd07b75-kube-api-access-25xnk\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.943857 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943696 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-etc-selinux\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.943857 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943725 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8758962d-fe0b-44ba-b914-8df03e5a733b-host-slash\") pod \"iptables-alerter-q2q92\" (UID: \"8758962d-fe0b-44ba-b914-8df03e5a733b\") " pod="openshift-network-operator/iptables-alerter-q2q92" Jul 21 18:30:40.943857 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943742 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-socket-dir\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.943857 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943761 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-node-log\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.943857 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943782 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-cni-netd\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.943857 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943833 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-cni-netd\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.944352 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943902 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-node-log\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.944352 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943931 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-socket-dir\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.944352 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943919 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-etc-selinux\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.944352 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943959 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19b651b5-3d20-413a-9bdc-695c0223b53b-cnibin\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.944352 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944002 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19b651b5-3d20-413a-9bdc-695c0223b53b-cnibin\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.944352 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.943996 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2szxj\" (UniqueName: \"kubernetes.io/projected/a470140f-489b-4888-b8a9-3602acdd8640-kube-api-access-2szxj\") pod \"network-metrics-daemon-649bh\" (UID: \"a470140f-489b-4888-b8a9-3602acdd8640\") " pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:40.944352 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944037 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-sysctl-conf\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.944352 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944004 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 18:30:40.944352 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944063 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d7c7edc-9147-4594-b939-9223b6fc6e54-hosts-file\") pod \"node-resolver-76v4f\" (UID: \"4d7c7edc-9147-4594-b939-9223b6fc6e54\") " pod="openshift-dns/node-resolver-76v4f" Jul 21 18:30:40.944352 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944206 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-sysctl-conf\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.944352 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944197 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/099eff05-04f7-4d97-9f16-47403e49f308-serviceca\") pod \"node-ca-272qz\" (UID: \"099eff05-04f7-4d97-9f16-47403e49f308\") " pod="openshift-image-registry/node-ca-272qz" Jul 21 18:30:40.944352 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944245 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19b651b5-3d20-413a-9bdc-695c0223b53b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.944352 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944264 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr5kb\" (UniqueName: \"kubernetes.io/projected/5c60db40-aa63-4bc3-8889-81225f113c8a-kube-api-access-rr5kb\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.944352 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944320 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-slash\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.944352 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944347 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19b651b5-3d20-413a-9bdc-695c0223b53b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.945106 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944368 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret\") pod \"global-pull-secret-syncer-khz8z\" (UID: \"7089390f-33ca-4e99-bb5c-0899bb33463d\") " pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:40.945106 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944380 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-slash\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.945106 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944384 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edef5c78-4c08-484b-aec7-d3a3ed263aa7-multus-daemon-config\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.945106 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944440 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-run-multus-certs\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.945106 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944468 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-etc-kubernetes\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.945106 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944495 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-kubernetes\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.945106 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944525 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-etc-openvswitch\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.945106 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944557 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-run-ovn-kubernetes\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.945106 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944589 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f54565df-771f-43bc-bc59-4b9eb71143e0-ovn-node-metrics-cert\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.945106 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944599 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-etc-kubernetes\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.945106 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944583 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19b651b5-3d20-413a-9bdc-695c0223b53b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.945106 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944622 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-var-lib-kubelet\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.945106 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:40.944640 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:40.945106 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944653 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-modprobe-d\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.945106 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944682 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-etc-openvswitch\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.945106 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944681 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-lib-modules\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.945106 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944714 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-run-multus-certs\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.945869 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:40.944736 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret podName:7089390f-33ca-4e99-bb5c-0899bb33463d nodeName:}" failed. No retries permitted until 2026-07-21 18:30:41.444695706 +0000 UTC m=+4.506775310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret") pod "global-pull-secret-syncer-khz8z" (UID: "7089390f-33ca-4e99-bb5c-0899bb33463d") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:40.945869 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944768 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-kubernetes\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.945869 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944819 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-lib-modules\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.945869 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944826 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6b1218e-fe6e-494c-ad23-41a05dd07b75-tmp\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.945869 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944863 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/edd7de87-d5d3-4603-ab7c-66455f711e59-konnectivity-ca\") pod \"konnectivity-agent-p9x2q\" (UID: \"edd7de87-d5d3-4603-ab7c-66455f711e59\") " pod="kube-system/konnectivity-agent-p9x2q" Jul 21 18:30:40.945869 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944920 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-cni-bin\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.945869 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944950 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6spfm\" (UniqueName: \"kubernetes.io/projected/19b651b5-3d20-413a-9bdc-695c0223b53b-kube-api-access-6spfm\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.945869 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944925 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-modprobe-d\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.945869 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944984 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7089390f-33ca-4e99-bb5c-0899bb33463d-dbus\") pod \"global-pull-secret-syncer-khz8z\" (UID: \"7089390f-33ca-4e99-bb5c-0899bb33463d\") " pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:40.945869 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.945006 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edef5c78-4c08-484b-aec7-d3a3ed263aa7-multus-daemon-config\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.945869 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.944956 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-run-ovn-kubernetes\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.945869 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.945076 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-cni-bin\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.945869 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.945101 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-sysconfig\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.945869 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.945126 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-host\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.945869 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.945180 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-sysconfig\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.945869 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.945181 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d7c7edc-9147-4594-b939-9223b6fc6e54-tmp-dir\") pod \"node-resolver-76v4f\" (UID: \"4d7c7edc-9147-4594-b939-9223b6fc6e54\") " pod="openshift-dns/node-resolver-76v4f" Jul 21 18:30:40.945869 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.945220 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-host\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.946680 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.945554 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7089390f-33ca-4e99-bb5c-0899bb33463d-dbus\") pod \"global-pull-secret-syncer-khz8z\" (UID: \"7089390f-33ca-4e99-bb5c-0899bb33463d\") " pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:40.946843 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.946781 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-var-lib-kubelet\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.948092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.947642 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-registration-dir\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.948092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.947718 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.948092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.947759 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7089390f-33ca-4e99-bb5c-0899bb33463d-kubelet-config\") pod \"global-pull-secret-syncer-khz8z\" (UID: \"7089390f-33ca-4e99-bb5c-0899bb33463d\") " pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:40.948092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.947873 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-multus-socket-dir-parent\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.948092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.947919 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7089390f-33ca-4e99-bb5c-0899bb33463d-kubelet-config\") pod \"global-pull-secret-syncer-khz8z\" (UID: \"7089390f-33ca-4e99-bb5c-0899bb33463d\") " pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:40.948092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.947942 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.948092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948009 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-var-lib-cni-multus\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.948092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948040 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-registration-dir\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.948092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948047 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-device-dir\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.948092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948095 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-run-systemd\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.948671 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948104 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-device-dir\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.948671 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948137 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-var-lib-openvswitch\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.948671 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948251 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-multus-socket-dir-parent\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.948671 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948307 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-tuned\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.948671 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948329 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-system-cni-dir\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.948671 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948403 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-var-lib-cni-multus\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.948671 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948404 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs\") pod \"network-metrics-daemon-649bh\" (UID: \"a470140f-489b-4888-b8a9-3602acdd8640\") " pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:40.948671 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948464 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-sys\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.948671 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948565 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-system-cni-dir\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.948671 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:40.948568 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:40.948671 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948602 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19b651b5-3d20-413a-9bdc-695c0223b53b-system-cni-dir\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.948671 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948643 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-run-systemd\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.948671 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:40.948648 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs podName:a470140f-489b-4888-b8a9-3602acdd8640 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:41.448628333 +0000 UTC m=+4.510707936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs") pod "network-metrics-daemon-649bh" (UID: "a470140f-489b-4888-b8a9-3602acdd8640") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:40.948671 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948671 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19b651b5-3d20-413a-9bdc-695c0223b53b-system-cni-dir\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.948671 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948679 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-hostroot\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.949501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948722 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-multus-conf-dir\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.949501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948728 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-sys\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.949501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948741 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-var-lib-openvswitch\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.949501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948794 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-hostroot\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.949501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948816 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-multus-conf-dir\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.949501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948831 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-systemd-units\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.949501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948871 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-os-release\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.949501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948903 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-systemd-units\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.949501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948958 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-sys-fs\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.949501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.948999 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-os-release\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.949501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.949065 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-run-netns\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.949501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.949149 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-run-netns\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.949501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.949254 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f54565df-771f-43bc-bc59-4b9eb71143e0-env-overrides\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.949501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.949264 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-sys-fs\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.949501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.949293 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqfdz\" (UniqueName: \"kubernetes.io/projected/f54565df-771f-43bc-bc59-4b9eb71143e0-kube-api-access-rqfdz\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.949501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.949322 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-systemd\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.949501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.949391 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-systemd\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.950364 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.949800 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f54565df-771f-43bc-bc59-4b9eb71143e0-env-overrides\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.950364 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.949809 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/099eff05-04f7-4d97-9f16-47403e49f308-host\") pod \"node-ca-272qz\" (UID: \"099eff05-04f7-4d97-9f16-47403e49f308\") " pod="openshift-image-registry/node-ca-272qz" Jul 21 18:30:40.950364 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.949860 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8758962d-fe0b-44ba-b914-8df03e5a733b-iptables-alerter-script\") pod \"iptables-alerter-q2q92\" (UID: \"8758962d-fe0b-44ba-b914-8df03e5a733b\") " pod="openshift-network-operator/iptables-alerter-q2q92" Jul 21 18:30:40.950364 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.949897 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-kubelet\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.950364 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.949971 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-host-kubelet\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.950364 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950006 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19b651b5-3d20-413a-9bdc-695c0223b53b-cni-binary-copy\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.950364 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950057 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19b651b5-3d20-413a-9bdc-695c0223b53b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.950364 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950092 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7lzk\" (UniqueName: \"kubernetes.io/projected/099eff05-04f7-4d97-9f16-47403e49f308-kube-api-access-h7lzk\") pod \"node-ca-272qz\" (UID: \"099eff05-04f7-4d97-9f16-47403e49f308\") " pod="openshift-image-registry/node-ca-272qz" Jul 21 18:30:40.950364 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950118 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-run-ovn\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.950364 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950151 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skmc6\" (UniqueName: \"kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6\") pod \"network-check-target-d9kjr\" (UID: \"287e892d-0539-4cd6-91c9-13035bd0f542\") " pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:30:40.950364 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950196 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-run-netns\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.950364 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950227 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-run-openvswitch\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.950364 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950256 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f54565df-771f-43bc-bc59-4b9eb71143e0-ovnkube-config\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.950364 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950282 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2zlj\" (UniqueName: \"kubernetes.io/projected/edef5c78-4c08-484b-aec7-d3a3ed263aa7-kube-api-access-b2zlj\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.950364 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950313 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.951237 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950366 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f54565df-771f-43bc-bc59-4b9eb71143e0-ovnkube-script-lib\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.951237 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950411 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19b651b5-3d20-413a-9bdc-695c0223b53b-os-release\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.951237 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950436 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-multus-cni-dir\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.951237 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950466 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edef5c78-4c08-484b-aec7-d3a3ed263aa7-cni-binary-copy\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.951237 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950548 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-run-k8s-cni-cncf-io\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.951237 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950605 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-run\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.951237 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950615 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19b651b5-3d20-413a-9bdc-695c0223b53b-cni-binary-copy\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.951237 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950685 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-run\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.951237 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950727 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/edd7de87-d5d3-4603-ab7c-66455f711e59-agent-certs\") pod \"konnectivity-agent-p9x2q\" (UID: \"edd7de87-d5d3-4603-ab7c-66455f711e59\") " pod="kube-system/konnectivity-agent-p9x2q" Jul 21 18:30:40.951237 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950763 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-sysctl-d\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.951237 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950793 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-var-lib-kubelet\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.951237 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950821 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6b1218e-fe6e-494c-ad23-41a05dd07b75-tmp\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.951237 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.950868 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgqs6\" (UniqueName: \"kubernetes.io/projected/4d7c7edc-9147-4594-b939-9223b6fc6e54-kube-api-access-mgqs6\") pod \"node-resolver-76v4f\" (UID: \"4d7c7edc-9147-4594-b939-9223b6fc6e54\") " pod="openshift-dns/node-resolver-76v4f" Jul 21 18:30:40.951237 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.951091 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-multus-cni-dir\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.951237 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.951110 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzj4n\" (UniqueName: \"kubernetes.io/projected/8758962d-fe0b-44ba-b914-8df03e5a733b-kube-api-access-jzj4n\") pod \"iptables-alerter-q2q92\" (UID: \"8758962d-fe0b-44ba-b914-8df03e5a733b\") " pod="openshift-network-operator/iptables-alerter-q2q92" Jul 21 18:30:40.952329 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.951400 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f54565df-771f-43bc-bc59-4b9eb71143e0-ovnkube-config\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.952329 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.951501 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-run-k8s-cni-cncf-io\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.952329 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.951538 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c60db40-aa63-4bc3-8889-81225f113c8a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.952329 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.951564 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-var-lib-kubelet\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.952329 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.951671 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-run-openvswitch\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.952329 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.952036 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edef5c78-4c08-484b-aec7-d3a3ed263aa7-cni-binary-copy\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.952329 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.952082 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f54565df-771f-43bc-bc59-4b9eb71143e0-ovn-node-metrics-cert\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.952329 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.952304 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19b651b5-3d20-413a-9bdc-695c0223b53b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.952874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.952835 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f54565df-771f-43bc-bc59-4b9eb71143e0-run-ovn\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.952972 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.952912 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edef5c78-4c08-484b-aec7-d3a3ed263aa7-host-run-netns\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.953990 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.953681 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19b651b5-3d20-413a-9bdc-695c0223b53b-os-release\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.953990 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.953723 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6b1218e-fe6e-494c-ad23-41a05dd07b75-etc-sysctl-d\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.953990 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.953926 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f54565df-771f-43bc-bc59-4b9eb71143e0-ovnkube-script-lib\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.954268 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.954206 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25xnk\" (UniqueName: \"kubernetes.io/projected/e6b1218e-fe6e-494c-ad23-41a05dd07b75-kube-api-access-25xnk\") pod \"tuned-kql8l\" (UID: \"e6b1218e-fe6e-494c-ad23-41a05dd07b75\") " pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:40.956834 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.956808 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr5kb\" (UniqueName: \"kubernetes.io/projected/5c60db40-aa63-4bc3-8889-81225f113c8a-kube-api-access-rr5kb\") pod \"aws-ebs-csi-driver-node-bkzrq\" (UID: \"5c60db40-aa63-4bc3-8889-81225f113c8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:40.957615 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.957144 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2szxj\" (UniqueName: \"kubernetes.io/projected/a470140f-489b-4888-b8a9-3602acdd8640-kube-api-access-2szxj\") pod \"network-metrics-daemon-649bh\" (UID: \"a470140f-489b-4888-b8a9-3602acdd8640\") " pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:40.957615 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.957571 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6spfm\" (UniqueName: \"kubernetes.io/projected/19b651b5-3d20-413a-9bdc-695c0223b53b-kube-api-access-6spfm\") pod \"multus-additional-cni-plugins-mm58k\" (UID: \"19b651b5-3d20-413a-9bdc-695c0223b53b\") " pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:40.957767 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:40.957654 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:30:40.957767 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:40.957678 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:30:40.957767 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:40.957692 2556 projected.go:196] Error preparing data for projected volume kube-api-access-skmc6 for pod openshift-network-diagnostics/network-check-target-d9kjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:40.957767 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:40.957763 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6 podName:287e892d-0539-4cd6-91c9-13035bd0f542 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:41.457745073 +0000 UTC m=+4.519824663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-skmc6" (UniqueName: "kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6") pod "network-check-target-d9kjr" (UID: "287e892d-0539-4cd6-91c9-13035bd0f542") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:40.958026 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.957943 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqfdz\" (UniqueName: \"kubernetes.io/projected/f54565df-771f-43bc-bc59-4b9eb71143e0-kube-api-access-rqfdz\") pod \"ovnkube-node-49tds\" (UID: \"f54565df-771f-43bc-bc59-4b9eb71143e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:40.959044 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.959024 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2zlj\" (UniqueName: \"kubernetes.io/projected/edef5c78-4c08-484b-aec7-d3a3ed263aa7-kube-api-access-b2zlj\") pod \"multus-d8kt6\" (UID: \"edef5c78-4c08-484b-aec7-d3a3ed263aa7\") " pod="openshift-multus/multus-d8kt6" Jul 21 18:30:40.981387 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.981326 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal" event={"ID":"d6c90ef6bbcb79b45f9b031a1263361d","Type":"ContainerStarted","Data":"772b2be0500e3cdeab0e985045e7fe52001bec06473dd9bfdeb021916c60991e"} Jul 21 18:30:40.982677 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:40.982641 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-34.ec2.internal" event={"ID":"ab365cfc620fcb9efb235526502a3d4a","Type":"ContainerStarted","Data":"f322104fb05ed5839c075856c3a50f96d4bb46d6d902a6fa838ba9868833059d"} Jul 21 18:30:41.052051 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.051963 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d7c7edc-9147-4594-b939-9223b6fc6e54-hosts-file\") pod \"node-resolver-76v4f\" (UID: \"4d7c7edc-9147-4594-b939-9223b6fc6e54\") " pod="openshift-dns/node-resolver-76v4f" Jul 21 18:30:41.052051 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.052005 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/099eff05-04f7-4d97-9f16-47403e49f308-serviceca\") pod \"node-ca-272qz\" (UID: \"099eff05-04f7-4d97-9f16-47403e49f308\") " pod="openshift-image-registry/node-ca-272qz" Jul 21 18:30:41.052287 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.052054 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/edd7de87-d5d3-4603-ab7c-66455f711e59-konnectivity-ca\") pod \"konnectivity-agent-p9x2q\" (UID: \"edd7de87-d5d3-4603-ab7c-66455f711e59\") " pod="kube-system/konnectivity-agent-p9x2q" Jul 21 18:30:41.052287 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.052083 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d7c7edc-9147-4594-b939-9223b6fc6e54-tmp-dir\") pod \"node-resolver-76v4f\" (UID: \"4d7c7edc-9147-4594-b939-9223b6fc6e54\") " pod="openshift-dns/node-resolver-76v4f" Jul 21 18:30:41.052287 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.052117 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d7c7edc-9147-4594-b939-9223b6fc6e54-hosts-file\") pod \"node-resolver-76v4f\" (UID: \"4d7c7edc-9147-4594-b939-9223b6fc6e54\") " pod="openshift-dns/node-resolver-76v4f" Jul 21 18:30:41.052287 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.052183 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/099eff05-04f7-4d97-9f16-47403e49f308-host\") pod \"node-ca-272qz\" (UID: \"099eff05-04f7-4d97-9f16-47403e49f308\") " pod="openshift-image-registry/node-ca-272qz" Jul 21 18:30:41.052287 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.052128 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/099eff05-04f7-4d97-9f16-47403e49f308-host\") pod \"node-ca-272qz\" (UID: \"099eff05-04f7-4d97-9f16-47403e49f308\") " pod="openshift-image-registry/node-ca-272qz" Jul 21 18:30:41.052287 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.052224 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8758962d-fe0b-44ba-b914-8df03e5a733b-iptables-alerter-script\") pod \"iptables-alerter-q2q92\" (UID: \"8758962d-fe0b-44ba-b914-8df03e5a733b\") " pod="openshift-network-operator/iptables-alerter-q2q92" Jul 21 18:30:41.052287 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.052252 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7lzk\" (UniqueName: \"kubernetes.io/projected/099eff05-04f7-4d97-9f16-47403e49f308-kube-api-access-h7lzk\") pod \"node-ca-272qz\" (UID: \"099eff05-04f7-4d97-9f16-47403e49f308\") " pod="openshift-image-registry/node-ca-272qz" Jul 21 18:30:41.052629 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.052321 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/edd7de87-d5d3-4603-ab7c-66455f711e59-agent-certs\") pod \"konnectivity-agent-p9x2q\" (UID: \"edd7de87-d5d3-4603-ab7c-66455f711e59\") " pod="kube-system/konnectivity-agent-p9x2q" Jul 21 18:30:41.052629 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.052351 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgqs6\" (UniqueName: \"kubernetes.io/projected/4d7c7edc-9147-4594-b939-9223b6fc6e54-kube-api-access-mgqs6\") pod \"node-resolver-76v4f\" (UID: \"4d7c7edc-9147-4594-b939-9223b6fc6e54\") " pod="openshift-dns/node-resolver-76v4f" Jul 21 18:30:41.052629 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.052376 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzj4n\" (UniqueName: \"kubernetes.io/projected/8758962d-fe0b-44ba-b914-8df03e5a733b-kube-api-access-jzj4n\") pod \"iptables-alerter-q2q92\" (UID: \"8758962d-fe0b-44ba-b914-8df03e5a733b\") " pod="openshift-network-operator/iptables-alerter-q2q92" Jul 21 18:30:41.052629 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.052409 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8758962d-fe0b-44ba-b914-8df03e5a733b-host-slash\") pod \"iptables-alerter-q2q92\" (UID: \"8758962d-fe0b-44ba-b914-8df03e5a733b\") " pod="openshift-network-operator/iptables-alerter-q2q92" Jul 21 18:30:41.052629 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.052480 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8758962d-fe0b-44ba-b914-8df03e5a733b-host-slash\") pod \"iptables-alerter-q2q92\" (UID: \"8758962d-fe0b-44ba-b914-8df03e5a733b\") " pod="openshift-network-operator/iptables-alerter-q2q92" Jul 21 18:30:41.052629 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.052500 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d7c7edc-9147-4594-b939-9223b6fc6e54-tmp-dir\") pod \"node-resolver-76v4f\" (UID: \"4d7c7edc-9147-4594-b939-9223b6fc6e54\") " pod="openshift-dns/node-resolver-76v4f" Jul 21 18:30:41.052944 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.052670 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/099eff05-04f7-4d97-9f16-47403e49f308-serviceca\") pod \"node-ca-272qz\" (UID: \"099eff05-04f7-4d97-9f16-47403e49f308\") " pod="openshift-image-registry/node-ca-272qz" Jul 21 18:30:41.052944 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.052739 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/edd7de87-d5d3-4603-ab7c-66455f711e59-konnectivity-ca\") pod \"konnectivity-agent-p9x2q\" (UID: \"edd7de87-d5d3-4603-ab7c-66455f711e59\") " pod="kube-system/konnectivity-agent-p9x2q" Jul 21 18:30:41.053242 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.053213 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8758962d-fe0b-44ba-b914-8df03e5a733b-iptables-alerter-script\") pod \"iptables-alerter-q2q92\" (UID: \"8758962d-fe0b-44ba-b914-8df03e5a733b\") " pod="openshift-network-operator/iptables-alerter-q2q92" Jul 21 18:30:41.055425 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.055399 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/edd7de87-d5d3-4603-ab7c-66455f711e59-agent-certs\") pod \"konnectivity-agent-p9x2q\" (UID: \"edd7de87-d5d3-4603-ab7c-66455f711e59\") " pod="kube-system/konnectivity-agent-p9x2q" Jul 21 18:30:41.070004 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.069968 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgqs6\" (UniqueName: \"kubernetes.io/projected/4d7c7edc-9147-4594-b939-9223b6fc6e54-kube-api-access-mgqs6\") pod \"node-resolver-76v4f\" (UID: \"4d7c7edc-9147-4594-b939-9223b6fc6e54\") " pod="openshift-dns/node-resolver-76v4f" Jul 21 18:30:41.070595 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.070573 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7lzk\" (UniqueName: \"kubernetes.io/projected/099eff05-04f7-4d97-9f16-47403e49f308-kube-api-access-h7lzk\") pod \"node-ca-272qz\" (UID: \"099eff05-04f7-4d97-9f16-47403e49f308\") " pod="openshift-image-registry/node-ca-272qz" Jul 21 18:30:41.070694 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.070643 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzj4n\" (UniqueName: \"kubernetes.io/projected/8758962d-fe0b-44ba-b914-8df03e5a733b-kube-api-access-jzj4n\") pod \"iptables-alerter-q2q92\" (UID: \"8758962d-fe0b-44ba-b914-8df03e5a733b\") " pod="openshift-network-operator/iptables-alerter-q2q92" Jul 21 18:30:41.135888 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.135836 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" Jul 21 18:30:41.141121 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.141094 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:30:41.150036 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.150006 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mm58k" Jul 21 18:30:41.155239 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.155219 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d8kt6" Jul 21 18:30:41.162077 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.162041 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kql8l" Jul 21 18:30:41.169809 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.169787 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-272qz" Jul 21 18:30:41.176647 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.176625 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q2q92" Jul 21 18:30:41.185042 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.185016 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-76v4f" Jul 21 18:30:41.189114 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.189094 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p9x2q" Jul 21 18:30:41.456025 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.455992 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs\") pod \"network-metrics-daemon-649bh\" (UID: \"a470140f-489b-4888-b8a9-3602acdd8640\") " pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:41.456154 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.456061 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret\") pod \"global-pull-secret-syncer-khz8z\" (UID: \"7089390f-33ca-4e99-bb5c-0899bb33463d\") " pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:41.456205 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:41.456177 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:41.456205 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:41.456181 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:41.456300 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:41.456236 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret podName:7089390f-33ca-4e99-bb5c-0899bb33463d nodeName:}" failed. No retries permitted until 2026-07-21 18:30:42.456219071 +0000 UTC m=+5.518298659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret") pod "global-pull-secret-syncer-khz8z" (UID: "7089390f-33ca-4e99-bb5c-0899bb33463d") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:41.456300 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:41.456254 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs podName:a470140f-489b-4888-b8a9-3602acdd8640 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:42.456245614 +0000 UTC m=+5.518325207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs") pod "network-metrics-daemon-649bh" (UID: "a470140f-489b-4888-b8a9-3602acdd8640") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:41.557182 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.557149 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skmc6\" (UniqueName: \"kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6\") pod \"network-check-target-d9kjr\" (UID: \"287e892d-0539-4cd6-91c9-13035bd0f542\") " pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:30:41.557347 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:41.557326 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:30:41.557347 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:41.557346 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:30:41.557418 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:41.557356 2556 projected.go:196] Error preparing data for projected volume kube-api-access-skmc6 for pod openshift-network-diagnostics/network-check-target-d9kjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:41.557418 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:41.557410 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6 podName:287e892d-0539-4cd6-91c9-13035bd0f542 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:42.557393583 +0000 UTC m=+5.619473175 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-skmc6" (UniqueName: "kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6") pod "network-check-target-d9kjr" (UID: "287e892d-0539-4cd6-91c9-13035bd0f542") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:41.689573 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:41.689544 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d7c7edc_9147_4594_b939_9223b6fc6e54.slice/crio-3334110d22fdc5915b086b75c161f7f60e45e5e7cc3eafce1673e31dbc75104e WatchSource:0}: Error finding container 3334110d22fdc5915b086b75c161f7f60e45e5e7cc3eafce1673e31dbc75104e: Status 404 returned error can't find the container with id 3334110d22fdc5915b086b75c161f7f60e45e5e7cc3eafce1673e31dbc75104e Jul 21 18:30:41.690833 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:41.690806 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b1218e_fe6e_494c_ad23_41a05dd07b75.slice/crio-f35ff932d2e759225b4a0b18cebaebcfdc5ce7657295b506e3f0c3851a4c3c3c WatchSource:0}: Error finding container f35ff932d2e759225b4a0b18cebaebcfdc5ce7657295b506e3f0c3851a4c3c3c: Status 404 returned error can't find the container with id f35ff932d2e759225b4a0b18cebaebcfdc5ce7657295b506e3f0c3851a4c3c3c Jul 21 18:30:41.692434 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:41.692409 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c60db40_aa63_4bc3_8889_81225f113c8a.slice/crio-c574c68b2e36f70884145c5c6556ba3eb7bffee9a51c3fd0f79997aff500eecc WatchSource:0}: Error finding container c574c68b2e36f70884145c5c6556ba3eb7bffee9a51c3fd0f79997aff500eecc: Status 404 returned error can't find the container with id c574c68b2e36f70884145c5c6556ba3eb7bffee9a51c3fd0f79997aff500eecc Jul 21 18:30:41.693433 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:41.693409 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099eff05_04f7_4d97_9f16_47403e49f308.slice/crio-88a9e37ec38e03b00abc7dd4001d20a5de3f8a1871f87b3de52477d702dd383d WatchSource:0}: Error finding container 88a9e37ec38e03b00abc7dd4001d20a5de3f8a1871f87b3de52477d702dd383d: Status 404 returned error can't find the container with id 88a9e37ec38e03b00abc7dd4001d20a5de3f8a1871f87b3de52477d702dd383d Jul 21 18:30:41.694980 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:41.694858 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd7de87_d5d3_4603_ab7c_66455f711e59.slice/crio-6c51d03828d5fe6f7014f5c9e555d65345a7503a359ade89bc34034b159646d9 WatchSource:0}: Error finding container 6c51d03828d5fe6f7014f5c9e555d65345a7503a359ade89bc34034b159646d9: Status 404 returned error can't find the container with id 6c51d03828d5fe6f7014f5c9e555d65345a7503a359ade89bc34034b159646d9 Jul 21 18:30:41.696432 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:41.696285 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedef5c78_4c08_484b_aec7_d3a3ed263aa7.slice/crio-3585bbc7a906852f46f87f4f5969b3eb1006da7e08b68a7ce70429d37beee8ac WatchSource:0}: Error finding container 3585bbc7a906852f46f87f4f5969b3eb1006da7e08b68a7ce70429d37beee8ac: Status 404 returned error can't find the container with id 3585bbc7a906852f46f87f4f5969b3eb1006da7e08b68a7ce70429d37beee8ac Jul 21 18:30:41.698332 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:41.698307 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b651b5_3d20_413a_9bdc_695c0223b53b.slice/crio-eff3b34d82248b517d447ef6fc5f87ec6093170dd7bf8b95c5d9328b51fda39b WatchSource:0}: Error finding container eff3b34d82248b517d447ef6fc5f87ec6093170dd7bf8b95c5d9328b51fda39b: Status 404 returned error can't find the container with id eff3b34d82248b517d447ef6fc5f87ec6093170dd7bf8b95c5d9328b51fda39b Jul 21 18:30:41.699503 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:30:41.699047 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8758962d_fe0b_44ba_b914_8df03e5a733b.slice/crio-41378805883a33ce7ef4633e7b766b322511738231d368648b09fc4d75eb1ccf WatchSource:0}: Error finding container 41378805883a33ce7ef4633e7b766b322511738231d368648b09fc4d75eb1ccf: Status 404 returned error can't find the container with id 41378805883a33ce7ef4633e7b766b322511738231d368648b09fc4d75eb1ccf Jul 21 18:30:41.882168 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.882116 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 18:25:41 +0000 UTC" deadline="2028-02-12 11:56:08.911939634 +0000 UTC" Jul 21 18:30:41.882168 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.882172 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13697h25m27.029772012s" Jul 21 18:30:41.975961 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.975658 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:41.976117 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:41.976052 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:30:41.985658 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.985617 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q2q92" event={"ID":"8758962d-fe0b-44ba-b914-8df03e5a733b","Type":"ContainerStarted","Data":"41378805883a33ce7ef4633e7b766b322511738231d368648b09fc4d75eb1ccf"} Jul 21 18:30:41.987055 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.987021 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mm58k" event={"ID":"19b651b5-3d20-413a-9bdc-695c0223b53b","Type":"ContainerStarted","Data":"eff3b34d82248b517d447ef6fc5f87ec6093170dd7bf8b95c5d9328b51fda39b"} Jul 21 18:30:41.988459 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.988433 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d8kt6" event={"ID":"edef5c78-4c08-484b-aec7-d3a3ed263aa7","Type":"ContainerStarted","Data":"3585bbc7a906852f46f87f4f5969b3eb1006da7e08b68a7ce70429d37beee8ac"} Jul 21 18:30:41.993379 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.993338 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" event={"ID":"5c60db40-aa63-4bc3-8889-81225f113c8a","Type":"ContainerStarted","Data":"c574c68b2e36f70884145c5c6556ba3eb7bffee9a51c3fd0f79997aff500eecc"} Jul 21 18:30:41.994652 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.994624 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-76v4f" event={"ID":"4d7c7edc-9147-4594-b939-9223b6fc6e54","Type":"ContainerStarted","Data":"3334110d22fdc5915b086b75c161f7f60e45e5e7cc3eafce1673e31dbc75104e"} Jul 21 18:30:41.996037 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.995996 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" event={"ID":"f54565df-771f-43bc-bc59-4b9eb71143e0","Type":"ContainerStarted","Data":"63c188bd96b8df154709134561ce4c714610d04e7a4b6163c5964a98832dc726"} Jul 21 18:30:41.998170 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.998147 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-34.ec2.internal" event={"ID":"ab365cfc620fcb9efb235526502a3d4a","Type":"ContainerStarted","Data":"0ff19d10c892ccd15941e6f4ff6ff088d2244a038d5a24f2de566cd6a4958814"} Jul 21 18:30:41.999272 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:41.999244 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p9x2q" event={"ID":"edd7de87-d5d3-4603-ab7c-66455f711e59","Type":"ContainerStarted","Data":"6c51d03828d5fe6f7014f5c9e555d65345a7503a359ade89bc34034b159646d9"} Jul 21 18:30:42.000383 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:42.000364 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-272qz" event={"ID":"099eff05-04f7-4d97-9f16-47403e49f308","Type":"ContainerStarted","Data":"88a9e37ec38e03b00abc7dd4001d20a5de3f8a1871f87b3de52477d702dd383d"} Jul 21 18:30:42.001620 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:42.001602 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kql8l" event={"ID":"e6b1218e-fe6e-494c-ad23-41a05dd07b75","Type":"ContainerStarted","Data":"f35ff932d2e759225b4a0b18cebaebcfdc5ce7657295b506e3f0c3851a4c3c3c"} Jul 21 18:30:42.014562 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:42.014518 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-34.ec2.internal" podStartSLOduration=2.014506182 podStartE2EDuration="2.014506182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:30:42.014408637 +0000 UTC m=+5.076488252" watchObservedRunningTime="2026-07-21 18:30:42.014506182 +0000 UTC m=+5.076585793" Jul 21 18:30:42.464898 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:42.464788 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret\") pod \"global-pull-secret-syncer-khz8z\" (UID: \"7089390f-33ca-4e99-bb5c-0899bb33463d\") " pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:42.464898 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:42.464862 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs\") pod \"network-metrics-daemon-649bh\" (UID: \"a470140f-489b-4888-b8a9-3602acdd8640\") " pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:42.465138 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:42.465002 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:42.465138 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:42.465070 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs podName:a470140f-489b-4888-b8a9-3602acdd8640 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:44.465049272 +0000 UTC m=+7.527128874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs") pod "network-metrics-daemon-649bh" (UID: "a470140f-489b-4888-b8a9-3602acdd8640") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:42.465555 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:42.465530 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:42.465695 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:42.465592 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret podName:7089390f-33ca-4e99-bb5c-0899bb33463d nodeName:}" failed. No retries permitted until 2026-07-21 18:30:44.46557459 +0000 UTC m=+7.527654192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret") pod "global-pull-secret-syncer-khz8z" (UID: "7089390f-33ca-4e99-bb5c-0899bb33463d") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:42.565593 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:42.565552 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skmc6\" (UniqueName: \"kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6\") pod \"network-check-target-d9kjr\" (UID: \"287e892d-0539-4cd6-91c9-13035bd0f542\") " pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:30:42.565793 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:42.565723 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:30:42.565793 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:42.565743 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:30:42.565793 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:42.565755 2556 projected.go:196] Error preparing data for projected volume kube-api-access-skmc6 for pod openshift-network-diagnostics/network-check-target-d9kjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:42.566132 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:42.565815 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6 podName:287e892d-0539-4cd6-91c9-13035bd0f542 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:44.565795891 +0000 UTC m=+7.627875480 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-skmc6" (UniqueName: "kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6") pod "network-check-target-d9kjr" (UID: "287e892d-0539-4cd6-91c9-13035bd0f542") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:42.883281 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:42.883163 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 18:25:41 +0000 UTC" deadline="2028-01-12 05:47:15.576879456 +0000 UTC" Jul 21 18:30:42.883281 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:42.883229 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12947h16m32.693655847s" Jul 21 18:30:42.980558 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:42.980522 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:30:42.980739 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:42.980674 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:30:42.981152 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:42.981129 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:42.981264 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:42.981241 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:30:43.975877 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:43.975844 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:43.976379 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:43.975997 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:30:44.483274 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:44.482475 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret\") pod \"global-pull-secret-syncer-khz8z\" (UID: \"7089390f-33ca-4e99-bb5c-0899bb33463d\") " pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:44.483274 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:44.482544 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs\") pod \"network-metrics-daemon-649bh\" (UID: \"a470140f-489b-4888-b8a9-3602acdd8640\") " pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:44.483274 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:44.482672 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:44.483274 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:44.482740 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs podName:a470140f-489b-4888-b8a9-3602acdd8640 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:48.482718086 +0000 UTC m=+11.544797721 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs") pod "network-metrics-daemon-649bh" (UID: "a470140f-489b-4888-b8a9-3602acdd8640") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:44.483274 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:44.483181 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:44.483274 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:44.483237 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret podName:7089390f-33ca-4e99-bb5c-0899bb33463d nodeName:}" failed. No retries permitted until 2026-07-21 18:30:48.48322085 +0000 UTC m=+11.545300445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret") pod "global-pull-secret-syncer-khz8z" (UID: "7089390f-33ca-4e99-bb5c-0899bb33463d") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:44.583907 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:44.583289 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skmc6\" (UniqueName: \"kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6\") pod \"network-check-target-d9kjr\" (UID: \"287e892d-0539-4cd6-91c9-13035bd0f542\") " pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:30:44.583907 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:44.583610 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:30:44.583907 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:44.583639 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:30:44.583907 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:44.583654 2556 projected.go:196] Error preparing data for projected volume kube-api-access-skmc6 for pod openshift-network-diagnostics/network-check-target-d9kjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:44.583907 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:44.583726 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6 podName:287e892d-0539-4cd6-91c9-13035bd0f542 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:48.583704745 +0000 UTC m=+11.645784334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-skmc6" (UniqueName: "kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6") pod "network-check-target-d9kjr" (UID: "287e892d-0539-4cd6-91c9-13035bd0f542") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:44.976079 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:44.975994 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:30:44.976549 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:44.976154 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:30:44.978723 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:44.978697 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:44.978862 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:44.978824 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:30:45.975798 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:45.975727 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:45.976031 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:45.975887 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:30:46.975449 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:46.975364 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:30:46.976101 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:46.975515 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:30:46.976101 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:46.975364 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:46.976101 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:46.976065 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:30:47.976101 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:47.976061 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:47.976635 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:47.976215 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:30:48.519132 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:48.519083 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs\") pod \"network-metrics-daemon-649bh\" (UID: \"a470140f-489b-4888-b8a9-3602acdd8640\") " pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:48.519330 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:48.519184 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret\") pod \"global-pull-secret-syncer-khz8z\" (UID: \"7089390f-33ca-4e99-bb5c-0899bb33463d\") " pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:48.519330 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:48.519253 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:48.519330 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:48.519301 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:48.519503 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:48.519337 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs podName:a470140f-489b-4888-b8a9-3602acdd8640 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:56.519313163 +0000 UTC m=+19.581392752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs") pod "network-metrics-daemon-649bh" (UID: "a470140f-489b-4888-b8a9-3602acdd8640") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:48.519503 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:48.519359 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret podName:7089390f-33ca-4e99-bb5c-0899bb33463d nodeName:}" failed. No retries permitted until 2026-07-21 18:30:56.519348434 +0000 UTC m=+19.581428022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret") pod "global-pull-secret-syncer-khz8z" (UID: "7089390f-33ca-4e99-bb5c-0899bb33463d") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:48.620316 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:48.620279 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skmc6\" (UniqueName: \"kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6\") pod \"network-check-target-d9kjr\" (UID: \"287e892d-0539-4cd6-91c9-13035bd0f542\") " pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:30:48.620496 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:48.620463 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:30:48.620496 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:48.620489 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:30:48.620613 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:48.620502 2556 projected.go:196] Error preparing data for projected volume kube-api-access-skmc6 for pod openshift-network-diagnostics/network-check-target-d9kjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:48.620613 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:48.620566 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6 podName:287e892d-0539-4cd6-91c9-13035bd0f542 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:56.620546577 +0000 UTC m=+19.682626171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-skmc6" (UniqueName: "kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6") pod "network-check-target-d9kjr" (UID: "287e892d-0539-4cd6-91c9-13035bd0f542") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:48.976750 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:48.976672 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:30:48.977193 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:48.976796 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:30:48.977193 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:48.976859 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:48.977193 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:48.976990 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:30:49.975478 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:49.975446 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:49.975709 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:49.975681 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:30:50.976222 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:50.975928 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:30:50.976222 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:50.975936 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:50.976222 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:50.976062 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:30:50.976222 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:50.976165 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:30:51.976078 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:51.976043 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:51.976256 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:51.976154 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:30:52.975554 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:52.975521 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:52.975554 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:52.975543 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:30:52.975757 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:52.975675 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:30:52.975803 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:52.975784 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:30:53.976092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:53.976054 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:53.976482 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:53.976167 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:30:54.048898 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:54.048857 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal" event={"ID":"d6c90ef6bbcb79b45f9b031a1263361d","Type":"ContainerStarted","Data":"8b7a3644052de496dc36e3ca20d64e3ff48aa412c8205f8e5e23c2ecf3d71e98"} Jul 21 18:30:54.975502 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:54.975462 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:30:54.975678 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:54.975598 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:30:54.975678 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:54.975654 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:54.975767 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:54.975753 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:30:55.975564 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:55.975533 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:55.976000 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:55.975646 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:30:56.584178 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:56.584132 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret\") pod \"global-pull-secret-syncer-khz8z\" (UID: \"7089390f-33ca-4e99-bb5c-0899bb33463d\") " pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:56.584360 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:56.584195 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs\") pod \"network-metrics-daemon-649bh\" (UID: \"a470140f-489b-4888-b8a9-3602acdd8640\") " pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:56.584360 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:56.584291 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:56.584360 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:56.584349 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs podName:a470140f-489b-4888-b8a9-3602acdd8640 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:12.58433043 +0000 UTC m=+35.646410037 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs") pod "network-metrics-daemon-649bh" (UID: "a470140f-489b-4888-b8a9-3602acdd8640") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:56.584516 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:56.584290 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:56.584516 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:56.584438 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret podName:7089390f-33ca-4e99-bb5c-0899bb33463d nodeName:}" failed. No retries permitted until 2026-07-21 18:31:12.584408355 +0000 UTC m=+35.646487969 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret") pod "global-pull-secret-syncer-khz8z" (UID: "7089390f-33ca-4e99-bb5c-0899bb33463d") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:56.684596 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:56.684557 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skmc6\" (UniqueName: \"kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6\") pod \"network-check-target-d9kjr\" (UID: \"287e892d-0539-4cd6-91c9-13035bd0f542\") " pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:30:56.684765 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:56.684711 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:30:56.684765 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:56.684728 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:30:56.684765 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:56.684737 2556 projected.go:196] Error preparing data for projected volume kube-api-access-skmc6 for pod openshift-network-diagnostics/network-check-target-d9kjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:56.684917 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:56.684787 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6 podName:287e892d-0539-4cd6-91c9-13035bd0f542 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:12.684773105 +0000 UTC m=+35.746852691 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-skmc6" (UniqueName: "kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6") pod "network-check-target-d9kjr" (UID: "287e892d-0539-4cd6-91c9-13035bd0f542") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:56.976012 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:56.975975 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:30:56.976012 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:56.975979 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:56.976488 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:56.976142 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:30:56.976488 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:56.976163 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:30:57.975218 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:57.975185 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:57.975412 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:57.975298 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:30:58.976981 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:58.976938 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:30:58.977433 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:58.977028 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:30:58.977433 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:58.977048 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:30:58.977433 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:58.977195 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:30:59.975950 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:30:59.975907 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:30:59.976137 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:30:59.976031 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:00.976349 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:00.976179 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:00.976947 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:00.976203 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:00.976947 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:00.976500 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:00.976947 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:00.976519 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:01.063313 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.063039 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d8kt6" event={"ID":"edef5c78-4c08-484b-aec7-d3a3ed263aa7","Type":"ContainerStarted","Data":"1f7879dbd4b4cc5d1a93e9db9a317cc81d2f8a03056d77adb3381877c968a5c8"} Jul 21 18:31:01.064563 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.064526 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" event={"ID":"5c60db40-aa63-4bc3-8889-81225f113c8a","Type":"ContainerStarted","Data":"ab37cc7871b4ad5468c979c59843473a00d09528eafd7644e40a3cb0a9b0f360"} Jul 21 18:31:01.065933 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.065906 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-76v4f" event={"ID":"4d7c7edc-9147-4594-b939-9223b6fc6e54","Type":"ContainerStarted","Data":"5c4f3ed76d966b03728fb68cb06ee1bd021c5e25127f3f7eb9e9d821e884f405"} Jul 21 18:31:01.067887 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.067864 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" event={"ID":"f54565df-771f-43bc-bc59-4b9eb71143e0","Type":"ContainerStarted","Data":"51b0ba36b005915fd426931398feb8cabbdbc649fecfb0333d321f43711468bc"} Jul 21 18:31:01.067984 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.067918 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" event={"ID":"f54565df-771f-43bc-bc59-4b9eb71143e0","Type":"ContainerStarted","Data":"e37cf2bbca1bbbf2590dd6a933bc8eee656b2d0c8f2d15d997b4149d87ff3652"} Jul 21 18:31:01.069125 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.069095 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p9x2q" event={"ID":"edd7de87-d5d3-4603-ab7c-66455f711e59","Type":"ContainerStarted","Data":"0fd0f7c6e8efb28d0c3a59c3e121892cdc031cd7fa38e80179a5a19a32936f26"} Jul 21 18:31:01.070583 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.070563 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-272qz" event={"ID":"099eff05-04f7-4d97-9f16-47403e49f308","Type":"ContainerStarted","Data":"cab2a4c83619f8be3499abc9973a9a8285cb1bda1df0b6d6f99cba447471dedb"} Jul 21 18:31:01.072109 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.072081 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kql8l" event={"ID":"e6b1218e-fe6e-494c-ad23-41a05dd07b75","Type":"ContainerStarted","Data":"ce8875f6db426c9166e5b528a473320f5502839a160b9c2a019de0a167907dd4"} Jul 21 18:31:01.073539 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.073520 2556 generic.go:356] "Generic (PLEG): container finished" podID="d6c90ef6bbcb79b45f9b031a1263361d" containerID="8b7a3644052de496dc36e3ca20d64e3ff48aa412c8205f8e5e23c2ecf3d71e98" exitCode=0 Jul 21 18:31:01.073626 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.073588 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal" event={"ID":"d6c90ef6bbcb79b45f9b031a1263361d","Type":"ContainerDied","Data":"8b7a3644052de496dc36e3ca20d64e3ff48aa412c8205f8e5e23c2ecf3d71e98"} Jul 21 18:31:01.075165 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.075140 2556 generic.go:356] "Generic (PLEG): container finished" podID="19b651b5-3d20-413a-9bdc-695c0223b53b" containerID="810d1f3b218b2dc2b6d4182ec72a1fb325e1ddc910d127c70f51cc901e3aaddd" exitCode=0 Jul 21 18:31:01.075235 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.075179 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mm58k" event={"ID":"19b651b5-3d20-413a-9bdc-695c0223b53b","Type":"ContainerDied","Data":"810d1f3b218b2dc2b6d4182ec72a1fb325e1ddc910d127c70f51cc901e3aaddd"} Jul 21 18:31:01.088000 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.087944 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d8kt6" podStartSLOduration=3.000329429 podStartE2EDuration="22.08792347s" totalImagesPullingTime="19.087594041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:01.087019175 +0000 UTC m=+24.149098782" watchObservedRunningTime="2026-07-21 18:31:01.08792347 +0000 UTC m=+24.150003078" Jul 21 18:31:01.107431 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.107387 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-76v4f" podStartSLOduration=11.342097941 podStartE2EDuration="22.107372145s" totalImagesPullingTime="10.765274204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:01.107229718 +0000 UTC m=+24.169309339" watchObservedRunningTime="2026-07-21 18:31:01.107372145 +0000 UTC m=+24.169451753" Jul 21 18:31:01.129212 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.129171 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p9x2q" podStartSLOduration=11.424309199 podStartE2EDuration="22.129156757s" totalImagesPullingTime="10.704847558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:01.129008997 +0000 UTC m=+24.191088596" watchObservedRunningTime="2026-07-21 18:31:01.129156757 +0000 UTC m=+24.191236364" Jul 21 18:31:01.154004 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.153962 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kql8l" podStartSLOduration=3.121126283 podStartE2EDuration="22.153946167s" totalImagesPullingTime="19.032819884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:01.153673942 +0000 UTC m=+24.215753550" watchObservedRunningTime="2026-07-21 18:31:01.153946167 +0000 UTC m=+24.216025775" Jul 21 18:31:01.173650 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.173556 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-272qz" podStartSLOduration=11.413056881 podStartE2EDuration="22.173540794s" totalImagesPullingTime="10.760483913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:01.173483098 +0000 UTC m=+24.235562705" watchObservedRunningTime="2026-07-21 18:31:01.173540794 +0000 UTC m=+24.235620402" Jul 21 18:31:01.975468 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:01.975394 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:01.975597 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:01.975496 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:02.078396 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:02.078363 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal" event={"ID":"d6c90ef6bbcb79b45f9b031a1263361d","Type":"ContainerStarted","Data":"62e0b7dc1d0db47913661b71e62d71150ecbcbb29bb6832ab743d0fd7bedcbc4"} Jul 21 18:31:02.079727 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:02.079703 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q2q92" event={"ID":"8758962d-fe0b-44ba-b914-8df03e5a733b","Type":"ContainerStarted","Data":"d19487b2bfc87c8ecaded082b3fc2f8658cdb753aa51e3315aeaf1f6c069c9ea"} Jul 21 18:31:02.082367 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:02.082335 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" event={"ID":"f54565df-771f-43bc-bc59-4b9eb71143e0","Type":"ContainerStarted","Data":"b07fb1f2f119c699b15c821e11564c38446d154adf235c06d81fc2e585cb25db"} Jul 21 18:31:02.082500 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:02.082483 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" event={"ID":"f54565df-771f-43bc-bc59-4b9eb71143e0","Type":"ContainerStarted","Data":"3fa268bdfc3ff742514b44f9317878f766617b3f87bb45b7e3579c8af1430b0e"} Jul 21 18:31:02.082566 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:02.082542 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" event={"ID":"f54565df-771f-43bc-bc59-4b9eb71143e0","Type":"ContainerStarted","Data":"a00bb82c547d6d376f2f242b119fc7a35be410c0d45ad95d670f24773a962d07"} Jul 21 18:31:02.082622 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:02.082590 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" event={"ID":"f54565df-771f-43bc-bc59-4b9eb71143e0","Type":"ContainerStarted","Data":"8579ec79ce3f82cd1b3de50190492a6b604b4bbc8cb576ea7dfe4987c1c14fa5"} Jul 21 18:31:02.264335 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:02.264303 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 18:31:02.565343 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:02.565276 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-76v4f_4d7c7edc-9147-4594-b939-9223b6fc6e54/dns-node-resolver/0.log" Jul 21 18:31:02.900053 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:02.899922 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T18:31:02.264320283Z","UUID":"eb1726b7-f04c-4092-ac62-a06acb2b8862","Handler":null,"Name":"","Endpoint":""} Jul 21 18:31:02.901607 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:02.901541 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 18:31:02.901607 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:02.901607 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 18:31:02.975692 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:02.975658 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:02.975881 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:02.975699 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:02.975881 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:02.975783 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:02.976005 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:02.975934 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:03.087345 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:03.087302 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" event={"ID":"5c60db40-aa63-4bc3-8889-81225f113c8a","Type":"ContainerStarted","Data":"acdf8beb1b45af66f7d0c8cb9bd826adf90e8fdbcd1ca08631dcf27f4235700f"} Jul 21 18:31:03.106094 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:03.106063 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p9x2q" Jul 21 18:31:03.106671 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:03.106653 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p9x2q" Jul 21 18:31:03.127687 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:03.127630 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-34.ec2.internal" podStartSLOduration=23.127613837 podStartE2EDuration="23.127613837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:02.099208222 +0000 UTC m=+25.161287830" watchObservedRunningTime="2026-07-21 18:31:03.127613837 +0000 UTC m=+26.189693433" Jul 21 18:31:03.128167 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:03.128128 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q2q92" podStartSLOduration=5.103853367 podStartE2EDuration="24.128114906s" totalImagesPullingTime="19.024261539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:03.127607608 +0000 UTC m=+26.189687217" watchObservedRunningTime="2026-07-21 18:31:03.128114906 +0000 UTC m=+26.190194545" Jul 21 18:31:03.530160 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:03.530138 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-272qz_099eff05-04f7-4d97-9f16-47403e49f308/node-ca/0.log" Jul 21 18:31:03.975600 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:03.975430 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:03.975865 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:03.975694 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:04.092448 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:04.092405 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" event={"ID":"5c60db40-aa63-4bc3-8889-81225f113c8a","Type":"ContainerStarted","Data":"2dc7723f960a3c1d61afcbf193971c6806efe9053f00270ef1106354bd23d563"} Jul 21 18:31:04.096324 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:04.096292 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" event={"ID":"f54565df-771f-43bc-bc59-4b9eb71143e0","Type":"ContainerStarted","Data":"0012529bb19351cace842b67378a7c8c69920a607483050f3ff73460f9467947"} Jul 21 18:31:04.096660 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:04.096519 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p9x2q" Jul 21 18:31:04.097174 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:04.097152 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p9x2q" Jul 21 18:31:04.116264 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:04.116218 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bkzrq" podStartSLOduration=11.952383816 podStartE2EDuration="25.116203424s" totalImagesPullingTime="13.163819608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:04.115808284 +0000 UTC m=+27.177887893" watchObservedRunningTime="2026-07-21 18:31:04.116203424 +0000 UTC m=+27.178283032" Jul 21 18:31:04.975915 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:04.975882 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:04.976108 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:04.975881 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:04.976108 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:04.976007 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:04.976222 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:04.976104 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:05.975717 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:05.975620 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:05.976611 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:05.975781 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:06.107599 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:06.107376 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" event={"ID":"f54565df-771f-43bc-bc59-4b9eb71143e0","Type":"ContainerStarted","Data":"5db43fb7fe6fa6945aa41bdba94a7120257c370ecc2f7b71bcab343aa047dcf3"} Jul 21 18:31:06.134935 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:06.134887 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" podStartSLOduration=8.021937396 podStartE2EDuration="27.134872753s" totalImagesPullingTime="19.112935357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:06.134375401 +0000 UTC m=+29.196455008" watchObservedRunningTime="2026-07-21 18:31:06.134872753 +0000 UTC m=+29.196952361" Jul 21 18:31:06.975549 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:06.975511 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:06.975741 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:06.975515 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:06.975741 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:06.975646 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:06.976183 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:06.975756 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:07.109742 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:07.109714 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 21 18:31:07.110184 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:07.110159 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:31:07.110296 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:07.110245 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:31:07.127952 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:07.127926 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:31:07.128107 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:07.128069 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:31:07.976017 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:07.975989 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:07.976400 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:07.976091 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:08.111421 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:08.111400 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 21 18:31:08.873636 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:08.873597 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:31:08.976077 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:08.976049 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:08.976468 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:08.976143 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:08.976468 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:08.976233 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:08.976468 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:08.976347 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:09.114922 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:09.114890 2556 generic.go:356] "Generic (PLEG): container finished" podID="19b651b5-3d20-413a-9bdc-695c0223b53b" containerID="79a7ccbbba6921f81286b9c45095578c4d3a1d96e2395e73cd3c6b823ed7fc43" exitCode=0 Jul 21 18:31:09.115104 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:09.114977 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mm58k" event={"ID":"19b651b5-3d20-413a-9bdc-695c0223b53b","Type":"ContainerDied","Data":"79a7ccbbba6921f81286b9c45095578c4d3a1d96e2395e73cd3c6b823ed7fc43"} Jul 21 18:31:09.975783 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:09.975751 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:09.975922 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:09.975869 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:10.118969 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:10.118937 2556 generic.go:356] "Generic (PLEG): container finished" podID="19b651b5-3d20-413a-9bdc-695c0223b53b" containerID="4822a32f7eb28200d787f5bcbae76a4ad8ac93afd44d87866c3faa357d5a0002" exitCode=0 Jul 21 18:31:10.119347 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:10.119023 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mm58k" event={"ID":"19b651b5-3d20-413a-9bdc-695c0223b53b","Type":"ContainerDied","Data":"4822a32f7eb28200d787f5bcbae76a4ad8ac93afd44d87866c3faa357d5a0002"} Jul 21 18:31:10.129756 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:10.129725 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" podUID="f54565df-771f-43bc-bc59-4b9eb71143e0" containerName="ovnkube-controller" probeResult="failure" output="" Jul 21 18:31:10.975678 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:10.975593 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:10.975678 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:10.975627 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:10.975953 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:10.975738 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:10.975953 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:10.975875 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:11.976176 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:11.976135 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:11.976572 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:11.976243 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:12.595093 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:12.595037 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret\") pod \"global-pull-secret-syncer-khz8z\" (UID: \"7089390f-33ca-4e99-bb5c-0899bb33463d\") " pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:12.595258 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:12.595115 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs\") pod \"network-metrics-daemon-649bh\" (UID: \"a470140f-489b-4888-b8a9-3602acdd8640\") " pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:12.595258 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:12.595195 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:31:12.595258 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:12.595217 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:31:12.595367 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:12.595264 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret podName:7089390f-33ca-4e99-bb5c-0899bb33463d nodeName:}" failed. No retries permitted until 2026-07-21 18:31:44.595247834 +0000 UTC m=+67.657327429 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret") pod "global-pull-secret-syncer-khz8z" (UID: "7089390f-33ca-4e99-bb5c-0899bb33463d") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:31:12.595367 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:12.595281 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs podName:a470140f-489b-4888-b8a9-3602acdd8640 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:44.59527396 +0000 UTC m=+67.657353549 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs") pod "network-metrics-daemon-649bh" (UID: "a470140f-489b-4888-b8a9-3602acdd8640") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:31:12.696339 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:12.696303 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skmc6\" (UniqueName: \"kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6\") pod \"network-check-target-d9kjr\" (UID: \"287e892d-0539-4cd6-91c9-13035bd0f542\") " pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:12.696484 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:12.696458 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:31:12.696484 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:12.696477 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:31:12.696572 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:12.696486 2556 projected.go:196] Error preparing data for projected volume kube-api-access-skmc6 for pod openshift-network-diagnostics/network-check-target-d9kjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:31:12.696572 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:12.696538 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6 podName:287e892d-0539-4cd6-91c9-13035bd0f542 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:44.696524404 +0000 UTC m=+67.758604011 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-skmc6" (UniqueName: "kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6") pod "network-check-target-d9kjr" (UID: "287e892d-0539-4cd6-91c9-13035bd0f542") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:31:12.975876 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:12.975767 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:12.976045 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:12.975912 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:12.976045 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:12.975959 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:12.976139 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:12.976047 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:13.975605 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:13.975512 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:13.975998 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:13.975621 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:14.129917 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:14.129876 2556 generic.go:356] "Generic (PLEG): container finished" podID="19b651b5-3d20-413a-9bdc-695c0223b53b" containerID="17e00c6102613e315f7805e9d50e2b7d924efce0e742253490937d668b58ab1b" exitCode=0 Jul 21 18:31:14.130059 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:14.129953 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mm58k" event={"ID":"19b651b5-3d20-413a-9bdc-695c0223b53b","Type":"ContainerDied","Data":"17e00c6102613e315f7805e9d50e2b7d924efce0e742253490937d668b58ab1b"} Jul 21 18:31:14.975512 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:14.975472 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:14.975782 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:14.975592 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:14.975782 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:14.975624 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:14.975782 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:14.975689 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:15.975821 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:15.975785 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:15.976255 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:15.975916 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:16.975936 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:16.975907 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:16.976406 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:16.976020 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:16.976406 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:16.976076 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:16.976406 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:16.976183 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:17.976197 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:17.976163 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:17.976641 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:17.976283 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:18.980039 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:18.980003 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:18.980512 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:18.980093 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:18.980512 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:18.980143 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:18.980512 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:18.980134 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:19.143395 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:19.143361 2556 generic.go:356] "Generic (PLEG): container finished" podID="19b651b5-3d20-413a-9bdc-695c0223b53b" containerID="c7b09d271bc4ce90ccf74a54be88912dcf8efd91c6444224f4a7c34c8e220db0" exitCode=0 Jul 21 18:31:19.143581 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:19.143415 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mm58k" event={"ID":"19b651b5-3d20-413a-9bdc-695c0223b53b","Type":"ContainerDied","Data":"c7b09d271bc4ce90ccf74a54be88912dcf8efd91c6444224f4a7c34c8e220db0"} Jul 21 18:31:19.976031 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:19.975840 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:19.976207 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:19.976109 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:20.148223 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:20.148190 2556 generic.go:356] "Generic (PLEG): container finished" podID="19b651b5-3d20-413a-9bdc-695c0223b53b" containerID="884e62acf30ffd5835cd2c0bed49de9b4d3a36b6932a3f9bdd77c9626264c721" exitCode=0 Jul 21 18:31:20.148580 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:20.148243 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mm58k" event={"ID":"19b651b5-3d20-413a-9bdc-695c0223b53b","Type":"ContainerDied","Data":"884e62acf30ffd5835cd2c0bed49de9b4d3a36b6932a3f9bdd77c9626264c721"} Jul 21 18:31:20.976203 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:20.976168 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:20.976386 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:20.976275 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:20.976386 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:20.976359 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:20.976480 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:20.976457 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:21.153560 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:21.153521 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mm58k" event={"ID":"19b651b5-3d20-413a-9bdc-695c0223b53b","Type":"ContainerStarted","Data":"ddbfa55dc467219c3f33fc40838a40acc0fd60183ff8ffe28411cc1d0d9ec8ae"} Jul 21 18:31:21.178779 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:21.178729 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mm58k" podStartSLOduration=15.674981299 podStartE2EDuration="42.178715631s" totalImagesPullingTime="26.503734332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:21.177492279 +0000 UTC m=+44.239571888" watchObservedRunningTime="2026-07-21 18:31:21.178715631 +0000 UTC m=+44.240795240" Jul 21 18:31:21.976082 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:21.976049 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:21.976253 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:21.976166 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:22.978242 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:22.978212 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:22.978622 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:22.978309 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:22.978622 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:22.978365 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:22.978622 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:22.978467 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:23.975637 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:23.975607 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:23.975806 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:23.975699 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:24.975284 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:24.975252 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:24.975751 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:24.975348 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:24.975751 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:24.975562 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:24.975751 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:24.975624 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:25.976182 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:25.976142 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:25.976560 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:25.976250 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:26.976229 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:26.976197 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:26.976622 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:26.976282 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:26.976622 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:26.976298 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:26.976622 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:26.976399 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:27.976000 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:27.975967 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:27.976171 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:27.976067 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:28.976775 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:28.976739 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:28.977183 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:28.976825 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:28.977183 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:28.976898 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:28.977183 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:28.976998 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:29.976094 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:29.976060 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:29.976262 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:29.976157 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:30.976268 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:30.976239 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:30.976796 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:30.976246 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:30.976796 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:30.976343 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:30.976796 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:30.976449 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:31.976214 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:31.976183 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:31.976347 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:31.976289 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:32.224137 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:32.224059 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-khz8z"] Jul 21 18:31:32.224290 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:32.224156 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:32.224290 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:32.224236 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:32.224700 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:32.224676 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-649bh"] Jul 21 18:31:32.224792 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:32.224779 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:32.224917 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:32.224899 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:32.235520 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:32.235496 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d9kjr"] Jul 21 18:31:32.235627 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:32.235573 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:32.235680 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:32.235641 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:33.975828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:33.975792 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:33.976349 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:33.975792 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:33.976349 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:33.975926 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:33.976349 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:33.975792 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:33.976349 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:33.975976 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:33.976349 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:33.976069 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:35.976135 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:35.975923 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:35.976665 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:35.975924 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:35.976665 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:35.976218 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9kjr" podUID="287e892d-0539-4cd6-91c9-13035bd0f542" Jul 21 18:31:35.976665 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:35.976339 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-649bh" podUID="a470140f-489b-4888-b8a9-3602acdd8640" Jul 21 18:31:35.976665 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:35.975939 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:35.976665 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:35.976448 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-khz8z" podUID="7089390f-33ca-4e99-bb5c-0899bb33463d" Jul 21 18:31:36.763049 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.763014 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-34.ec2.internal" event="NodeReady" Jul 21 18:31:36.763242 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.763176 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 18:31:36.816121 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.816086 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k886l"] Jul 21 18:31:36.818184 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.818165 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k886l" Jul 21 18:31:36.818381 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.818362 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fmq2l"] Jul 21 18:31:36.819917 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.819902 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fmq2l" Jul 21 18:31:36.822894 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.822874 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 18:31:36.823008 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.822962 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xwq42\"" Jul 21 18:31:36.823008 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.822983 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 18:31:36.823737 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.823516 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j4zws\"" Jul 21 18:31:36.823737 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.823703 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 18:31:36.823737 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.823717 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 18:31:36.823950 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.823900 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 18:31:36.832138 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.832120 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k886l"] Jul 21 18:31:36.844385 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.844366 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8l9zb"] Jul 21 18:31:36.846187 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.846174 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8l9zb" Jul 21 18:31:36.849498 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.849477 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 18:31:36.849754 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.849738 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-98l98\"" Jul 21 18:31:36.850014 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.849999 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 18:31:36.850085 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.849999 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 18:31:36.850512 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.850497 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 18:31:36.850602 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.850546 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fmq2l"] Jul 21 18:31:36.864025 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.864002 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8l9zb"] Jul 21 18:31:36.871731 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.871710 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4516a5a2-5ec8-4665-8c5c-77a4d809dcfb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8l9zb\" (UID: \"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb\") " pod="openshift-insights/insights-runtime-extractor-8l9zb" Jul 21 18:31:36.871862 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.871743 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffe8c1b3-67b0-4726-8ae2-917e3077319c-config-volume\") pod \"dns-default-k886l\" (UID: \"ffe8c1b3-67b0-4726-8ae2-917e3077319c\") " pod="openshift-dns/dns-default-k886l" Jul 21 18:31:36.871862 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.871767 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4516a5a2-5ec8-4665-8c5c-77a4d809dcfb-crio-socket\") pod \"insights-runtime-extractor-8l9zb\" (UID: \"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb\") " pod="openshift-insights/insights-runtime-extractor-8l9zb" Jul 21 18:31:36.871862 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.871808 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpqvs\" (UniqueName: \"kubernetes.io/projected/a2266407-4301-41ee-847b-7b648be92c94-kube-api-access-jpqvs\") pod \"ingress-canary-fmq2l\" (UID: \"a2266407-4301-41ee-847b-7b648be92c94\") " pod="openshift-ingress-canary/ingress-canary-fmq2l" Jul 21 18:31:36.872030 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.871958 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4516a5a2-5ec8-4665-8c5c-77a4d809dcfb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8l9zb\" (UID: \"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb\") " pod="openshift-insights/insights-runtime-extractor-8l9zb" Jul 21 18:31:36.872030 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.871984 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffe8c1b3-67b0-4726-8ae2-917e3077319c-tmp-dir\") pod \"dns-default-k886l\" (UID: \"ffe8c1b3-67b0-4726-8ae2-917e3077319c\") " pod="openshift-dns/dns-default-k886l" Jul 21 18:31:36.872030 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.872007 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nml7h\" (UniqueName: \"kubernetes.io/projected/ffe8c1b3-67b0-4726-8ae2-917e3077319c-kube-api-access-nml7h\") pod \"dns-default-k886l\" (UID: \"ffe8c1b3-67b0-4726-8ae2-917e3077319c\") " pod="openshift-dns/dns-default-k886l" Jul 21 18:31:36.872174 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.872059 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffe8c1b3-67b0-4726-8ae2-917e3077319c-metrics-tls\") pod \"dns-default-k886l\" (UID: \"ffe8c1b3-67b0-4726-8ae2-917e3077319c\") " pod="openshift-dns/dns-default-k886l" Jul 21 18:31:36.872174 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.872096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8wtg\" (UniqueName: \"kubernetes.io/projected/4516a5a2-5ec8-4665-8c5c-77a4d809dcfb-kube-api-access-m8wtg\") pod \"insights-runtime-extractor-8l9zb\" (UID: \"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb\") " pod="openshift-insights/insights-runtime-extractor-8l9zb" Jul 21 18:31:36.872174 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.872135 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2266407-4301-41ee-847b-7b648be92c94-cert\") pod \"ingress-canary-fmq2l\" (UID: \"a2266407-4301-41ee-847b-7b648be92c94\") " pod="openshift-ingress-canary/ingress-canary-fmq2l" Jul 21 18:31:36.872174 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.872159 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4516a5a2-5ec8-4665-8c5c-77a4d809dcfb-data-volume\") pod \"insights-runtime-extractor-8l9zb\" (UID: \"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb\") " pod="openshift-insights/insights-runtime-extractor-8l9zb" Jul 21 18:31:36.973475 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.973441 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4516a5a2-5ec8-4665-8c5c-77a4d809dcfb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8l9zb\" (UID: \"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb\") " pod="openshift-insights/insights-runtime-extractor-8l9zb" Jul 21 18:31:36.973475 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.973478 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffe8c1b3-67b0-4726-8ae2-917e3077319c-config-volume\") pod \"dns-default-k886l\" (UID: \"ffe8c1b3-67b0-4726-8ae2-917e3077319c\") " pod="openshift-dns/dns-default-k886l" Jul 21 18:31:36.973701 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.973502 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4516a5a2-5ec8-4665-8c5c-77a4d809dcfb-crio-socket\") pod \"insights-runtime-extractor-8l9zb\" (UID: \"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb\") " pod="openshift-insights/insights-runtime-extractor-8l9zb" Jul 21 18:31:36.973701 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.973526 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpqvs\" (UniqueName: \"kubernetes.io/projected/a2266407-4301-41ee-847b-7b648be92c94-kube-api-access-jpqvs\") pod \"ingress-canary-fmq2l\" (UID: \"a2266407-4301-41ee-847b-7b648be92c94\") " pod="openshift-ingress-canary/ingress-canary-fmq2l" Jul 21 18:31:36.973701 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.973588 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4516a5a2-5ec8-4665-8c5c-77a4d809dcfb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8l9zb\" (UID: \"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb\") " pod="openshift-insights/insights-runtime-extractor-8l9zb" Jul 21 18:31:36.973701 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.973610 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffe8c1b3-67b0-4726-8ae2-917e3077319c-tmp-dir\") pod \"dns-default-k886l\" (UID: \"ffe8c1b3-67b0-4726-8ae2-917e3077319c\") " pod="openshift-dns/dns-default-k886l" Jul 21 18:31:36.973701 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.973634 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nml7h\" (UniqueName: \"kubernetes.io/projected/ffe8c1b3-67b0-4726-8ae2-917e3077319c-kube-api-access-nml7h\") pod \"dns-default-k886l\" (UID: \"ffe8c1b3-67b0-4726-8ae2-917e3077319c\") " pod="openshift-dns/dns-default-k886l" Jul 21 18:31:36.973979 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.973691 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4516a5a2-5ec8-4665-8c5c-77a4d809dcfb-crio-socket\") pod \"insights-runtime-extractor-8l9zb\" (UID: \"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb\") " pod="openshift-insights/insights-runtime-extractor-8l9zb" Jul 21 18:31:36.973979 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.973743 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffe8c1b3-67b0-4726-8ae2-917e3077319c-metrics-tls\") pod \"dns-default-k886l\" (UID: \"ffe8c1b3-67b0-4726-8ae2-917e3077319c\") " pod="openshift-dns/dns-default-k886l" Jul 21 18:31:36.973979 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.973773 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8wtg\" (UniqueName: \"kubernetes.io/projected/4516a5a2-5ec8-4665-8c5c-77a4d809dcfb-kube-api-access-m8wtg\") pod \"insights-runtime-extractor-8l9zb\" (UID: \"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb\") " pod="openshift-insights/insights-runtime-extractor-8l9zb" Jul 21 18:31:36.973979 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.973794 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2266407-4301-41ee-847b-7b648be92c94-cert\") pod \"ingress-canary-fmq2l\" (UID: \"a2266407-4301-41ee-847b-7b648be92c94\") " pod="openshift-ingress-canary/ingress-canary-fmq2l" Jul 21 18:31:36.973979 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.973813 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4516a5a2-5ec8-4665-8c5c-77a4d809dcfb-data-volume\") pod \"insights-runtime-extractor-8l9zb\" (UID: \"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb\") " pod="openshift-insights/insights-runtime-extractor-8l9zb" Jul 21 18:31:36.974205 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.973987 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffe8c1b3-67b0-4726-8ae2-917e3077319c-tmp-dir\") pod \"dns-default-k886l\" (UID: \"ffe8c1b3-67b0-4726-8ae2-917e3077319c\") " pod="openshift-dns/dns-default-k886l" Jul 21 18:31:36.974205 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.974111 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4516a5a2-5ec8-4665-8c5c-77a4d809dcfb-data-volume\") pod \"insights-runtime-extractor-8l9zb\" (UID: \"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb\") " pod="openshift-insights/insights-runtime-extractor-8l9zb" Jul 21 18:31:36.974303 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.974240 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffe8c1b3-67b0-4726-8ae2-917e3077319c-config-volume\") pod \"dns-default-k886l\" (UID: \"ffe8c1b3-67b0-4726-8ae2-917e3077319c\") " pod="openshift-dns/dns-default-k886l" Jul 21 18:31:36.974303 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.974244 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4516a5a2-5ec8-4665-8c5c-77a4d809dcfb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8l9zb\" (UID: \"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb\") " pod="openshift-insights/insights-runtime-extractor-8l9zb" Jul 21 18:31:36.977586 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.977562 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4516a5a2-5ec8-4665-8c5c-77a4d809dcfb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8l9zb\" (UID: \"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb\") " pod="openshift-insights/insights-runtime-extractor-8l9zb" Jul 21 18:31:36.977930 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.977635 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffe8c1b3-67b0-4726-8ae2-917e3077319c-metrics-tls\") pod \"dns-default-k886l\" (UID: \"ffe8c1b3-67b0-4726-8ae2-917e3077319c\") " pod="openshift-dns/dns-default-k886l" Jul 21 18:31:36.977930 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.977724 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2266407-4301-41ee-847b-7b648be92c94-cert\") pod \"ingress-canary-fmq2l\" (UID: \"a2266407-4301-41ee-847b-7b648be92c94\") " pod="openshift-ingress-canary/ingress-canary-fmq2l" Jul 21 18:31:36.980934 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.980912 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8wtg\" (UniqueName: \"kubernetes.io/projected/4516a5a2-5ec8-4665-8c5c-77a4d809dcfb-kube-api-access-m8wtg\") pod \"insights-runtime-extractor-8l9zb\" (UID: \"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb\") " pod="openshift-insights/insights-runtime-extractor-8l9zb" Jul 21 18:31:36.982072 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.982050 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nml7h\" (UniqueName: \"kubernetes.io/projected/ffe8c1b3-67b0-4726-8ae2-917e3077319c-kube-api-access-nml7h\") pod \"dns-default-k886l\" (UID: \"ffe8c1b3-67b0-4726-8ae2-917e3077319c\") " pod="openshift-dns/dns-default-k886l" Jul 21 18:31:36.982344 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:36.982320 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpqvs\" (UniqueName: \"kubernetes.io/projected/a2266407-4301-41ee-847b-7b648be92c94-kube-api-access-jpqvs\") pod \"ingress-canary-fmq2l\" (UID: \"a2266407-4301-41ee-847b-7b648be92c94\") " pod="openshift-ingress-canary/ingress-canary-fmq2l" Jul 21 18:31:37.131606 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:37.131578 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k886l" Jul 21 18:31:37.137375 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:37.137353 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fmq2l" Jul 21 18:31:37.155610 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:37.155580 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8l9zb" Jul 21 18:31:37.292420 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:37.292370 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fmq2l"] Jul 21 18:31:37.296526 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:31:37.296499 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2266407_4301_41ee_847b_7b648be92c94.slice/crio-0884f734479a45dbae6436d2b962829fa008844e804f5bc19c993826bc8be001 WatchSource:0}: Error finding container 0884f734479a45dbae6436d2b962829fa008844e804f5bc19c993826bc8be001: Status 404 returned error can't find the container with id 0884f734479a45dbae6436d2b962829fa008844e804f5bc19c993826bc8be001 Jul 21 18:31:37.299994 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:37.299924 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k886l"] Jul 21 18:31:37.303153 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:31:37.303129 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe8c1b3_67b0_4726_8ae2_917e3077319c.slice/crio-49272d0c78b8ab4cb1a301174445eebac366ac81d8942c4ba3c75eef68a561c6 WatchSource:0}: Error finding container 49272d0c78b8ab4cb1a301174445eebac366ac81d8942c4ba3c75eef68a561c6: Status 404 returned error can't find the container with id 49272d0c78b8ab4cb1a301174445eebac366ac81d8942c4ba3c75eef68a561c6 Jul 21 18:31:37.313895 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:37.313872 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8l9zb"] Jul 21 18:31:37.316877 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:31:37.316826 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4516a5a2_5ec8_4665_8c5c_77a4d809dcfb.slice/crio-b0ed5bd0a74d261c53852ce85d3b91e10cecb7a218deb2b05a9058fa2ce789b0 WatchSource:0}: Error finding container b0ed5bd0a74d261c53852ce85d3b91e10cecb7a218deb2b05a9058fa2ce789b0: Status 404 returned error can't find the container with id b0ed5bd0a74d261c53852ce85d3b91e10cecb7a218deb2b05a9058fa2ce789b0 Jul 21 18:31:37.976143 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:37.976058 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:37.976987 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:37.976364 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:37.976987 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:37.976073 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:37.982092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:37.980409 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 18:31:37.982092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:37.980662 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 18:31:37.982092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:37.980879 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v2r4n\"" Jul 21 18:31:37.982092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:37.981163 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 18:31:37.982092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:37.981387 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 18:31:37.982092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:37.981576 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mgcmw\"" Jul 21 18:31:38.195089 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:38.195050 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8l9zb" event={"ID":"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb","Type":"ContainerStarted","Data":"b0ed5bd0a74d261c53852ce85d3b91e10cecb7a218deb2b05a9058fa2ce789b0"} Jul 21 18:31:38.197903 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:38.197867 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fmq2l" event={"ID":"a2266407-4301-41ee-847b-7b648be92c94","Type":"ContainerStarted","Data":"0884f734479a45dbae6436d2b962829fa008844e804f5bc19c993826bc8be001"} Jul 21 18:31:38.200440 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:38.200411 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k886l" event={"ID":"ffe8c1b3-67b0-4726-8ae2-917e3077319c","Type":"ContainerStarted","Data":"49272d0c78b8ab4cb1a301174445eebac366ac81d8942c4ba3c75eef68a561c6"} Jul 21 18:31:40.001446 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.001411 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp"] Jul 21 18:31:40.015350 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.015322 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp"] Jul 21 18:31:40.015577 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.015450 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" Jul 21 18:31:40.018528 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.018496 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 21 18:31:40.018718 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.018587 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 18:31:40.018937 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.018918 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vhhgq\"" Jul 21 18:31:40.018937 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.018940 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 21 18:31:40.019121 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.018952 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 18:31:40.019121 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.018939 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 18:31:40.099977 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.099940 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-qqnjp\" (UID: \"cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" Jul 21 18:31:40.100169 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.099997 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-qqnjp\" (UID: \"cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" Jul 21 18:31:40.100169 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.100067 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-qqnjp\" (UID: \"cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" Jul 21 18:31:40.100169 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.100159 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwg84\" (UniqueName: \"kubernetes.io/projected/cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21-kube-api-access-zwg84\") pod \"prometheus-operator-5945b5cfd-qqnjp\" (UID: \"cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" Jul 21 18:31:40.130563 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.130533 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-49tds" Jul 21 18:31:40.200860 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.200809 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-qqnjp\" (UID: \"cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" Jul 21 18:31:40.201052 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.200878 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-qqnjp\" (UID: \"cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" Jul 21 18:31:40.201052 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.200912 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-qqnjp\" (UID: \"cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" Jul 21 18:31:40.201052 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.201018 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwg84\" (UniqueName: \"kubernetes.io/projected/cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21-kube-api-access-zwg84\") pod \"prometheus-operator-5945b5cfd-qqnjp\" (UID: \"cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" Jul 21 18:31:40.201225 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:40.201068 2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 21 18:31:40.201225 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:31:40.201143 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21-prometheus-operator-tls podName:cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:40.701122163 +0000 UTC m=+63.763201766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-qqnjp" (UID: "cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21") : secret "prometheus-operator-tls" not found Jul 21 18:31:40.201666 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.201617 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-qqnjp\" (UID: \"cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" Jul 21 18:31:40.203884 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.203862 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-qqnjp\" (UID: \"cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" Jul 21 18:31:40.210640 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.210613 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwg84\" (UniqueName: \"kubernetes.io/projected/cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21-kube-api-access-zwg84\") pod \"prometheus-operator-5945b5cfd-qqnjp\" (UID: \"cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" Jul 21 18:31:40.706450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.706409 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-qqnjp\" (UID: \"cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" Jul 21 18:31:40.709185 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.709161 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-qqnjp\" (UID: \"cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" Jul 21 18:31:40.927456 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:40.927418 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" Jul 21 18:31:43.073295 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.073192 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp"] Jul 21 18:31:43.077972 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:31:43.077944 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd2efcd0_16c5_4fa2_8f80_aea4b4ab8c21.slice/crio-72748031806e2116042984d0702bbe19e4eb739f7de284dbe285a9bbc22568c4 WatchSource:0}: Error finding container 72748031806e2116042984d0702bbe19e4eb739f7de284dbe285a9bbc22568c4: Status 404 returned error can't find the container with id 72748031806e2116042984d0702bbe19e4eb739f7de284dbe285a9bbc22568c4 Jul 21 18:31:43.215585 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.215467 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fmq2l" event={"ID":"a2266407-4301-41ee-847b-7b648be92c94","Type":"ContainerStarted","Data":"57b702790d7614e159a2c34fe263375f89805fb2dc1fd3dc5f5069a7ea7c3b38"} Jul 21 18:31:43.216780 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.216752 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" event={"ID":"cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21","Type":"ContainerStarted","Data":"72748031806e2116042984d0702bbe19e4eb739f7de284dbe285a9bbc22568c4"} Jul 21 18:31:43.218261 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.218229 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8l9zb" event={"ID":"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb","Type":"ContainerStarted","Data":"eee8322eef52571173512139bf35f1664d13eedb5835c6ab9ae4d0bc1426114c"} Jul 21 18:31:43.219997 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.219974 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k886l" event={"ID":"ffe8c1b3-67b0-4726-8ae2-917e3077319c","Type":"ContainerStarted","Data":"08a7a1f5e721ddf2502f2bdc51d1c389a5f37ecf061ab046f2fb9a72b4c72cb6"} Jul 21 18:31:43.220087 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.220018 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k886l" event={"ID":"ffe8c1b3-67b0-4726-8ae2-917e3077319c","Type":"ContainerStarted","Data":"da3b1633db9f12bd636921837e97cf0ec247cba74815f82277a659965c977555"} Jul 21 18:31:43.220136 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.220114 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k886l" Jul 21 18:31:43.241217 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.241167 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fmq2l" podStartSLOduration=1.617788346 podStartE2EDuration="7.241151942s" totalImagesPullingTime="5.623363596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:43.24077977 +0000 UTC m=+66.302859379" watchObservedRunningTime="2026-07-21 18:31:43.241151942 +0000 UTC m=+66.303231584" Jul 21 18:31:43.522629 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.522526 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-k886l" podStartSLOduration=1.906833347 podStartE2EDuration="7.522506577s" totalImagesPullingTime="5.61567323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:43.281105549 +0000 UTC m=+66.343185157" watchObservedRunningTime="2026-07-21 18:31:43.522506577 +0000 UTC m=+66.584586192" Jul 21 18:31:43.522767 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.522661 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-959bf9d7b-zlhhc"] Jul 21 18:31:43.524622 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.524606 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.528173 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.528149 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 21 18:31:43.532216 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.531984 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 21 18:31:43.532216 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.532005 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 21 18:31:43.532216 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.532011 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 21 18:31:43.532216 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.532093 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 21 18:31:43.532216 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.532135 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 21 18:31:43.532216 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.532142 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cxgbh\"" Jul 21 18:31:43.532502 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.532400 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 21 18:31:43.540404 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.540382 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-959bf9d7b-zlhhc"] Jul 21 18:31:43.630044 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.629998 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/87065a55-9201-4843-9862-591d50a9085b-console-oauth-config\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.630044 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.630039 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-service-ca\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.630296 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.630145 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-console-config\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.630296 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.630192 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/87065a55-9201-4843-9862-591d50a9085b-console-serving-cert\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.630296 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.630234 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdnst\" (UniqueName: \"kubernetes.io/projected/87065a55-9201-4843-9862-591d50a9085b-kube-api-access-mdnst\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.630454 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.630331 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-oauth-serving-cert\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.731361 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.731317 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-oauth-serving-cert\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.731551 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.731452 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/87065a55-9201-4843-9862-591d50a9085b-console-oauth-config\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.731551 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.731484 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-service-ca\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.731551 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.731511 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-console-config\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.731551 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.731544 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/87065a55-9201-4843-9862-591d50a9085b-console-serving-cert\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.731809 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.731571 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdnst\" (UniqueName: \"kubernetes.io/projected/87065a55-9201-4843-9862-591d50a9085b-kube-api-access-mdnst\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.732348 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.732298 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-oauth-serving-cert\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.732588 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.732524 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-service-ca\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.732588 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.732524 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-console-config\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.735769 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.735705 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/87065a55-9201-4843-9862-591d50a9085b-console-serving-cert\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.736283 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.736257 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/87065a55-9201-4843-9862-591d50a9085b-console-oauth-config\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.743027 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.742978 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdnst\" (UniqueName: \"kubernetes.io/projected/87065a55-9201-4843-9862-591d50a9085b-kube-api-access-mdnst\") pod \"console-959bf9d7b-zlhhc\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:43.837461 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:43.837202 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:44.009467 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:44.009422 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-959bf9d7b-zlhhc"] Jul 21 18:31:44.014297 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:31:44.014270 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87065a55_9201_4843_9862_591d50a9085b.slice/crio-bbde79767e2d42ce95c8547956395a9ffd2ef5e20fc8030919f69ebb7f22ea83 WatchSource:0}: Error finding container bbde79767e2d42ce95c8547956395a9ffd2ef5e20fc8030919f69ebb7f22ea83: Status 404 returned error can't find the container with id bbde79767e2d42ce95c8547956395a9ffd2ef5e20fc8030919f69ebb7f22ea83 Jul 21 18:31:44.224659 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:44.224569 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-959bf9d7b-zlhhc" event={"ID":"87065a55-9201-4843-9862-591d50a9085b","Type":"ContainerStarted","Data":"bbde79767e2d42ce95c8547956395a9ffd2ef5e20fc8030919f69ebb7f22ea83"} Jul 21 18:31:44.640916 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:44.640884 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret\") pod \"global-pull-secret-syncer-khz8z\" (UID: \"7089390f-33ca-4e99-bb5c-0899bb33463d\") " pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:44.641058 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:44.640954 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs\") pod \"network-metrics-daemon-649bh\" (UID: \"a470140f-489b-4888-b8a9-3602acdd8640\") " pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:44.644000 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:44.643976 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 18:31:44.644906 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:44.644884 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 18:31:44.654118 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:44.654099 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a470140f-489b-4888-b8a9-3602acdd8640-metrics-certs\") pod \"network-metrics-daemon-649bh\" (UID: \"a470140f-489b-4888-b8a9-3602acdd8640\") " pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:44.654222 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:44.654159 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7089390f-33ca-4e99-bb5c-0899bb33463d-original-pull-secret\") pod \"global-pull-secret-syncer-khz8z\" (UID: \"7089390f-33ca-4e99-bb5c-0899bb33463d\") " pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:44.742420 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:44.742359 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skmc6\" (UniqueName: \"kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6\") pod \"network-check-target-d9kjr\" (UID: \"287e892d-0539-4cd6-91c9-13035bd0f542\") " pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:44.744870 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:44.744821 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 18:31:44.756210 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:44.756153 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 18:31:44.769627 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:44.769573 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skmc6\" (UniqueName: \"kubernetes.io/projected/287e892d-0539-4cd6-91c9-13035bd0f542-kube-api-access-skmc6\") pod \"network-check-target-d9kjr\" (UID: \"287e892d-0539-4cd6-91c9-13035bd0f542\") " pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:44.907741 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:44.907669 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mgcmw\"" Jul 21 18:31:44.915948 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:44.915923 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-649bh" Jul 21 18:31:44.917784 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:44.917748 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v2r4n\"" Jul 21 18:31:44.923444 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:44.923384 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-khz8z" Jul 21 18:31:44.924958 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:44.924939 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:45.229464 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:45.229369 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" event={"ID":"cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21","Type":"ContainerStarted","Data":"d09fd9b25bc587d17ecb8a5bba7b27b295518a841f19bd14816d078ac4223511"} Jul 21 18:31:45.229464 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:45.229435 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" event={"ID":"cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21","Type":"ContainerStarted","Data":"f54958ee2f305b78fcf359278cb5d3b5da3ec7be6f881696bdf5f48951e15f6f"} Jul 21 18:31:47.433555 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.433482 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qqnjp" podStartSLOduration=6.911183136 podStartE2EDuration="8.433457542s" totalImagesPullingTime="1.522274406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:45.255129193 +0000 UTC m=+68.317208803" watchObservedRunningTime="2026-07-21 18:31:47.433457542 +0000 UTC m=+70.495537153" Jul 21 18:31:47.433992 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.433903 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc"] Jul 21 18:31:47.439965 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.439942 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" Jul 21 18:31:47.442810 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.442760 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-g69mk\"" Jul 21 18:31:47.442810 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.442789 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 21 18:31:47.443143 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.443122 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 21 18:31:47.456024 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.455992 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc"] Jul 21 18:31:47.512732 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.512699 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-55zgr"] Jul 21 18:31:47.516546 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.516365 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.520895 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.520858 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 18:31:47.521182 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.521151 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 18:31:47.521307 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.521237 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 18:31:47.521962 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.521941 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nptl5\"" Jul 21 18:31:47.564493 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.564456 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/84e00cf0-3628-4bac-9e53-69e4fec29d69-node-exporter-tls\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.564658 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.564514 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3637f426-8a31-4ceb-b13c-f14f26788359-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bnngc\" (UID: \"3637f426-8a31-4ceb-b13c-f14f26788359\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" Jul 21 18:31:47.564658 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.564579 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/84e00cf0-3628-4bac-9e53-69e4fec29d69-root\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.564778 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.564650 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/84e00cf0-3628-4bac-9e53-69e4fec29d69-node-exporter-wtmp\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.564778 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.564685 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84e00cf0-3628-4bac-9e53-69e4fec29d69-sys\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.564778 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.564721 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3637f426-8a31-4ceb-b13c-f14f26788359-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-bnngc\" (UID: \"3637f426-8a31-4ceb-b13c-f14f26788359\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" Jul 21 18:31:47.564940 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.564838 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e00cf0-3628-4bac-9e53-69e4fec29d69-metrics-client-ca\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.564940 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.564896 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/84e00cf0-3628-4bac-9e53-69e4fec29d69-node-exporter-accelerators-collector-config\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.565070 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.564967 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84e00cf0-3628-4bac-9e53-69e4fec29d69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.565070 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.565017 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l4xs\" (UniqueName: \"kubernetes.io/projected/84e00cf0-3628-4bac-9e53-69e4fec29d69-kube-api-access-4l4xs\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.565070 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.565042 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkqx8\" (UniqueName: \"kubernetes.io/projected/3637f426-8a31-4ceb-b13c-f14f26788359-kube-api-access-vkqx8\") pod \"openshift-state-metrics-79f6958cdf-bnngc\" (UID: \"3637f426-8a31-4ceb-b13c-f14f26788359\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" Jul 21 18:31:47.565181 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.565074 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3637f426-8a31-4ceb-b13c-f14f26788359-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-bnngc\" (UID: \"3637f426-8a31-4ceb-b13c-f14f26788359\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" Jul 21 18:31:47.565181 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.565132 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/84e00cf0-3628-4bac-9e53-69e4fec29d69-node-exporter-textfile\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.666503 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.666472 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84e00cf0-3628-4bac-9e53-69e4fec29d69-sys\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.666503 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.666518 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3637f426-8a31-4ceb-b13c-f14f26788359-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-bnngc\" (UID: \"3637f426-8a31-4ceb-b13c-f14f26788359\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" Jul 21 18:31:47.666731 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.666596 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84e00cf0-3628-4bac-9e53-69e4fec29d69-sys\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.666731 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.666641 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e00cf0-3628-4bac-9e53-69e4fec29d69-metrics-client-ca\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.666731 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.666674 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/84e00cf0-3628-4bac-9e53-69e4fec29d69-node-exporter-accelerators-collector-config\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.666731 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.666705 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84e00cf0-3628-4bac-9e53-69e4fec29d69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.666943 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.666750 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l4xs\" (UniqueName: \"kubernetes.io/projected/84e00cf0-3628-4bac-9e53-69e4fec29d69-kube-api-access-4l4xs\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.666943 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.666778 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkqx8\" (UniqueName: \"kubernetes.io/projected/3637f426-8a31-4ceb-b13c-f14f26788359-kube-api-access-vkqx8\") pod \"openshift-state-metrics-79f6958cdf-bnngc\" (UID: \"3637f426-8a31-4ceb-b13c-f14f26788359\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" Jul 21 18:31:47.666943 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.666810 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3637f426-8a31-4ceb-b13c-f14f26788359-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-bnngc\" (UID: \"3637f426-8a31-4ceb-b13c-f14f26788359\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" Jul 21 18:31:47.666943 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.666866 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/84e00cf0-3628-4bac-9e53-69e4fec29d69-node-exporter-textfile\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.666943 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.666894 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/84e00cf0-3628-4bac-9e53-69e4fec29d69-node-exporter-tls\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.666943 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.666920 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3637f426-8a31-4ceb-b13c-f14f26788359-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bnngc\" (UID: \"3637f426-8a31-4ceb-b13c-f14f26788359\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" Jul 21 18:31:47.667213 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.666950 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/84e00cf0-3628-4bac-9e53-69e4fec29d69-root\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.667213 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.666976 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/84e00cf0-3628-4bac-9e53-69e4fec29d69-node-exporter-wtmp\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.667213 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.667149 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/84e00cf0-3628-4bac-9e53-69e4fec29d69-node-exporter-wtmp\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.667376 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.667351 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e00cf0-3628-4bac-9e53-69e4fec29d69-metrics-client-ca\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.667426 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.667352 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3637f426-8a31-4ceb-b13c-f14f26788359-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-bnngc\" (UID: \"3637f426-8a31-4ceb-b13c-f14f26788359\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" Jul 21 18:31:47.667479 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.667417 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/84e00cf0-3628-4bac-9e53-69e4fec29d69-node-exporter-accelerators-collector-config\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.667479 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.667432 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/84e00cf0-3628-4bac-9e53-69e4fec29d69-node-exporter-textfile\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.667573 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.667498 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/84e00cf0-3628-4bac-9e53-69e4fec29d69-root\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.669865 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.669825 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3637f426-8a31-4ceb-b13c-f14f26788359-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-bnngc\" (UID: \"3637f426-8a31-4ceb-b13c-f14f26788359\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" Jul 21 18:31:47.669865 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.669859 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/84e00cf0-3628-4bac-9e53-69e4fec29d69-node-exporter-tls\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.670052 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.669876 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84e00cf0-3628-4bac-9e53-69e4fec29d69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.670403 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.670381 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3637f426-8a31-4ceb-b13c-f14f26788359-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bnngc\" (UID: \"3637f426-8a31-4ceb-b13c-f14f26788359\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" Jul 21 18:31:47.678100 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.678070 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkqx8\" (UniqueName: \"kubernetes.io/projected/3637f426-8a31-4ceb-b13c-f14f26788359-kube-api-access-vkqx8\") pod \"openshift-state-metrics-79f6958cdf-bnngc\" (UID: \"3637f426-8a31-4ceb-b13c-f14f26788359\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" Jul 21 18:31:47.678244 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.678166 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l4xs\" (UniqueName: \"kubernetes.io/projected/84e00cf0-3628-4bac-9e53-69e4fec29d69-kube-api-access-4l4xs\") pod \"node-exporter-55zgr\" (UID: \"84e00cf0-3628-4bac-9e53-69e4fec29d69\") " pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:47.751236 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.751149 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" Jul 21 18:31:47.827150 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:47.827119 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-55zgr" Jul 21 18:31:48.087294 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:48.087038 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-649bh"] Jul 21 18:31:48.090196 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:31:48.090156 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda470140f_489b_4888_b8a9_3602acdd8640.slice/crio-4d8d9dc936c1c3c04ffe14a4b28aa31d63bc6c1418dede06d3c11ef48625f43d WatchSource:0}: Error finding container 4d8d9dc936c1c3c04ffe14a4b28aa31d63bc6c1418dede06d3c11ef48625f43d: Status 404 returned error can't find the container with id 4d8d9dc936c1c3c04ffe14a4b28aa31d63bc6c1418dede06d3c11ef48625f43d Jul 21 18:31:48.145205 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:48.145173 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc"] Jul 21 18:31:48.148000 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:31:48.147971 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3637f426_8a31_4ceb_b13c_f14f26788359.slice/crio-1e4f4c79ffe80a0bdfe0d1eba0ff39b35844d8c2db956394aae3d800cccc1c78 WatchSource:0}: Error finding container 1e4f4c79ffe80a0bdfe0d1eba0ff39b35844d8c2db956394aae3d800cccc1c78: Status 404 returned error can't find the container with id 1e4f4c79ffe80a0bdfe0d1eba0ff39b35844d8c2db956394aae3d800cccc1c78 Jul 21 18:31:48.242612 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:48.242579 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8l9zb" event={"ID":"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb","Type":"ContainerStarted","Data":"b06e6a5fedab757b98f40bc7cbf8830ba3d34d2b5b01e3b3ec230dcf3800a2ed"} Jul 21 18:31:48.244433 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:48.244406 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-959bf9d7b-zlhhc" event={"ID":"87065a55-9201-4843-9862-591d50a9085b","Type":"ContainerStarted","Data":"e5e553e5e71301d49f65ff83ad1358461c51254a748f631d1b713f08ec397995"} Jul 21 18:31:48.245813 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:48.245787 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-55zgr" event={"ID":"84e00cf0-3628-4bac-9e53-69e4fec29d69","Type":"ContainerStarted","Data":"9638ccb0e7e8823a5af9b9e1c5cacdbc551fa8ac725916eb34a391c31302a629"} Jul 21 18:31:48.247287 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:48.247264 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" event={"ID":"3637f426-8a31-4ceb-b13c-f14f26788359","Type":"ContainerStarted","Data":"25f1c9c773d9d016ec313c9bc70a9325ed7a734aae210e5f4cbc22e0fd55f1c3"} Jul 21 18:31:48.247392 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:48.247314 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" event={"ID":"3637f426-8a31-4ceb-b13c-f14f26788359","Type":"ContainerStarted","Data":"1e4f4c79ffe80a0bdfe0d1eba0ff39b35844d8c2db956394aae3d800cccc1c78"} Jul 21 18:31:48.248452 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:48.248430 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-649bh" event={"ID":"a470140f-489b-4888-b8a9-3602acdd8640","Type":"ContainerStarted","Data":"4d8d9dc936c1c3c04ffe14a4b28aa31d63bc6c1418dede06d3c11ef48625f43d"} Jul 21 18:31:48.288481 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:48.287871 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-959bf9d7b-zlhhc" podStartSLOduration=1.368176977 podStartE2EDuration="5.287830593s" totalImagesPullingTime="3.919653616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:48.28608277 +0000 UTC m=+71.348162378" watchObservedRunningTime="2026-07-21 18:31:48.287830593 +0000 UTC m=+71.349910202" Jul 21 18:31:48.318019 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:48.317761 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d9kjr"] Jul 21 18:31:48.318782 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:48.318756 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-khz8z"] Jul 21 18:31:48.319929 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:31:48.319906 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287e892d_0539_4cd6_91c9_13035bd0f542.slice/crio-1eb25d6bd7ef5855f94f8af5dd42f3307f5e9a508a2893538f845a2b3eaac35a WatchSource:0}: Error finding container 1eb25d6bd7ef5855f94f8af5dd42f3307f5e9a508a2893538f845a2b3eaac35a: Status 404 returned error can't find the container with id 1eb25d6bd7ef5855f94f8af5dd42f3307f5e9a508a2893538f845a2b3eaac35a Jul 21 18:31:48.320575 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:31:48.320545 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7089390f_33ca_4e99_bb5c_0899bb33463d.slice/crio-4d71067dc0b00d4db690794a9b23657ffcc42d0b965fc160a9a39c9cf05a7a43 WatchSource:0}: Error finding container 4d71067dc0b00d4db690794a9b23657ffcc42d0b965fc160a9a39c9cf05a7a43: Status 404 returned error can't find the container with id 4d71067dc0b00d4db690794a9b23657ffcc42d0b965fc160a9a39c9cf05a7a43 Jul 21 18:31:49.256917 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:49.256879 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d9kjr" event={"ID":"287e892d-0539-4cd6-91c9-13035bd0f542","Type":"ContainerStarted","Data":"1eb25d6bd7ef5855f94f8af5dd42f3307f5e9a508a2893538f845a2b3eaac35a"} Jul 21 18:31:49.262601 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:49.262513 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" event={"ID":"3637f426-8a31-4ceb-b13c-f14f26788359","Type":"ContainerStarted","Data":"bff2aa0fea54490a92eb911ac758106bc0189f17ab9502ab43d1789c83017fb1"} Jul 21 18:31:49.266458 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:49.266396 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-khz8z" event={"ID":"7089390f-33ca-4e99-bb5c-0899bb33463d","Type":"ContainerStarted","Data":"4d71067dc0b00d4db690794a9b23657ffcc42d0b965fc160a9a39c9cf05a7a43"} Jul 21 18:31:50.275007 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:50.274374 2556 generic.go:356] "Generic (PLEG): container finished" podID="84e00cf0-3628-4bac-9e53-69e4fec29d69" containerID="b9747ec713a133eacd6145225818304d50bd830da0c94cff3452b33e9fe666cd" exitCode=0 Jul 21 18:31:50.275007 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:50.274474 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-55zgr" event={"ID":"84e00cf0-3628-4bac-9e53-69e4fec29d69","Type":"ContainerDied","Data":"b9747ec713a133eacd6145225818304d50bd830da0c94cff3452b33e9fe666cd"} Jul 21 18:31:50.287060 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:50.284052 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" event={"ID":"3637f426-8a31-4ceb-b13c-f14f26788359","Type":"ContainerStarted","Data":"505ef37d0ff6c35b172a487862747f8ac0192e8bcc7b8d541e69fcd743c6b964"} Jul 21 18:31:50.289292 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:50.288790 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-649bh" event={"ID":"a470140f-489b-4888-b8a9-3602acdd8640","Type":"ContainerStarted","Data":"b084bab5f2112bd83af3d5d28e47c59dd7f475d0d6278bbc0ad422a66a5d36c5"} Jul 21 18:31:50.289292 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:50.288860 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-649bh" event={"ID":"a470140f-489b-4888-b8a9-3602acdd8640","Type":"ContainerStarted","Data":"9b3638b1b4123b87a269509eb4523bfebd0adb1e3452499e76e354a79c24e18a"} Jul 21 18:31:50.321510 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:50.320380 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-649bh" podStartSLOduration=70.24566082 podStartE2EDuration="1m11.320359811s" totalImagesPullingTime="1.074698991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:50.318468735 +0000 UTC m=+73.380548343" watchObservedRunningTime="2026-07-21 18:31:50.320359811 +0000 UTC m=+73.382439422" Jul 21 18:31:50.337828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:50.337610 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bnngc" podStartSLOduration=1.827581197 podStartE2EDuration="3.337588626s" totalImagesPullingTime="1.510007429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:50.337276819 +0000 UTC m=+73.399356427" watchObservedRunningTime="2026-07-21 18:31:50.337588626 +0000 UTC m=+73.399668235" Jul 21 18:31:51.295761 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.295723 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-55zgr" event={"ID":"84e00cf0-3628-4bac-9e53-69e4fec29d69","Type":"ContainerStarted","Data":"e9f410e7eae8196c0854a5140a3fe5c6bd138687c7ec69d0f1f11d7cc9ef6136"} Jul 21 18:31:51.664100 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.664065 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7bc69b775-2s5jc"] Jul 21 18:31:51.783996 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.783956 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bc69b775-2s5jc"] Jul 21 18:31:51.784151 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.784119 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:51.787349 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.787319 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nfzm9\"" Jul 21 18:31:51.787669 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.787646 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 21 18:31:51.787776 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.787756 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 21 18:31:51.788398 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.788255 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 21 18:31:51.788398 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.788266 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 21 18:31:51.788563 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.788276 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-65u7uut17bren\"" Jul 21 18:31:51.788563 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.788333 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 21 18:31:51.904172 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.904133 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-grpc-tls\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:51.904341 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.904206 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:51.904341 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.904250 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:51.904341 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.904273 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:51.904341 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.904299 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-thanos-querier-tls\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:51.904578 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.904348 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-982cv\" (UniqueName: \"kubernetes.io/projected/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-kube-api-access-982cv\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:51.904578 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.904383 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-metrics-client-ca\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:51.904578 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:51.904411 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.005902 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.005808 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-grpc-tls\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.005902 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.005877 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.006115 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.005919 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.006115 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.005950 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.006115 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.005973 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-thanos-querier-tls\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.006115 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.006004 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-982cv\" (UniqueName: \"kubernetes.io/projected/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-kube-api-access-982cv\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.006115 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.006043 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-metrics-client-ca\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.006115 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.006072 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.007499 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.007421 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-metrics-client-ca\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.009145 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.009115 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.009966 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.009648 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.009966 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.009887 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.010160 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.010056 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-thanos-querier-tls\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.011169 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.011144 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-grpc-tls\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.012377 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.012047 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-597cf6959c-zhrhr"] Jul 21 18:31:52.013177 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.013154 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.018672 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.018652 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-982cv\" (UniqueName: \"kubernetes.io/projected/1cc854a5-5e90-4176-9be5-4b0f6ddc743d-kube-api-access-982cv\") pod \"thanos-querier-7bc69b775-2s5jc\" (UID: \"1cc854a5-5e90-4176-9be5-4b0f6ddc743d\") " pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.069656 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.069623 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-597cf6959c-zhrhr"] Jul 21 18:31:52.069817 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.069719 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.072985 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.072960 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 21 18:31:52.073138 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.073107 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 21 18:31:52.073213 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.073200 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 21 18:31:52.073269 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.073211 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8n8lp\"" Jul 21 18:31:52.073604 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.073498 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 21 18:31:52.073880 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.073862 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-30mn1coooiss\"" Jul 21 18:31:52.096240 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.096209 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:31:52.207110 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.207069 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d334e0d5-185a-42fd-b391-88948ddd293c-audit-log\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.207307 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.207166 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d334e0d5-185a-42fd-b391-88948ddd293c-secret-metrics-server-client-certs\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.207307 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.207224 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d334e0d5-185a-42fd-b391-88948ddd293c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.207431 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.207309 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d334e0d5-185a-42fd-b391-88948ddd293c-metrics-server-audit-profiles\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.207431 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.207354 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d334e0d5-185a-42fd-b391-88948ddd293c-secret-metrics-server-tls\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.207535 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.207442 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d334e0d5-185a-42fd-b391-88948ddd293c-client-ca-bundle\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.207535 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.207480 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99wsr\" (UniqueName: \"kubernetes.io/projected/d334e0d5-185a-42fd-b391-88948ddd293c-kube-api-access-99wsr\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.247038 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.246984 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5wpwk"] Jul 21 18:31:52.276185 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.276111 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5wpwk"] Jul 21 18:31:52.276334 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.276236 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5wpwk" Jul 21 18:31:52.279242 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.279204 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 21 18:31:52.279365 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.279214 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-5sz56\"" Jul 21 18:31:52.307921 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.307890 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d334e0d5-185a-42fd-b391-88948ddd293c-metrics-server-audit-profiles\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.308362 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.307946 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d334e0d5-185a-42fd-b391-88948ddd293c-secret-metrics-server-tls\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.308362 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.307982 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d334e0d5-185a-42fd-b391-88948ddd293c-client-ca-bundle\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.308362 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.308017 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99wsr\" (UniqueName: \"kubernetes.io/projected/d334e0d5-185a-42fd-b391-88948ddd293c-kube-api-access-99wsr\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.308362 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.308056 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d334e0d5-185a-42fd-b391-88948ddd293c-audit-log\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.308362 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.308091 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d334e0d5-185a-42fd-b391-88948ddd293c-secret-metrics-server-client-certs\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.308362 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.308122 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d334e0d5-185a-42fd-b391-88948ddd293c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.308799 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.308778 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d334e0d5-185a-42fd-b391-88948ddd293c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.309035 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.309009 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d334e0d5-185a-42fd-b391-88948ddd293c-metrics-server-audit-profiles\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.309154 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.309133 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d334e0d5-185a-42fd-b391-88948ddd293c-audit-log\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.311384 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.311337 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d334e0d5-185a-42fd-b391-88948ddd293c-client-ca-bundle\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.311545 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.311514 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d334e0d5-185a-42fd-b391-88948ddd293c-secret-metrics-server-tls\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.311909 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.311892 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d334e0d5-185a-42fd-b391-88948ddd293c-secret-metrics-server-client-certs\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.317365 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.317346 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99wsr\" (UniqueName: \"kubernetes.io/projected/d334e0d5-185a-42fd-b391-88948ddd293c-kube-api-access-99wsr\") pod \"metrics-server-597cf6959c-zhrhr\" (UID: \"d334e0d5-185a-42fd-b391-88948ddd293c\") " pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.382763 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.382725 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:31:52.409329 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.409306 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfthf\" (UniqueName: \"kubernetes.io/projected/2a4bf924-cc08-4f1b-8b34-28881d7cd679-kube-api-access-hfthf\") pod \"monitoring-plugin-7b7b7bc8bf-5wpwk\" (UID: \"2a4bf924-cc08-4f1b-8b34-28881d7cd679\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5wpwk" Jul 21 18:31:52.409427 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.409366 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a4bf924-cc08-4f1b-8b34-28881d7cd679-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-5wpwk\" (UID: \"2a4bf924-cc08-4f1b-8b34-28881d7cd679\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5wpwk" Jul 21 18:31:52.510236 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.510196 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a4bf924-cc08-4f1b-8b34-28881d7cd679-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-5wpwk\" (UID: \"2a4bf924-cc08-4f1b-8b34-28881d7cd679\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5wpwk" Jul 21 18:31:52.510499 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.510258 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfthf\" (UniqueName: \"kubernetes.io/projected/2a4bf924-cc08-4f1b-8b34-28881d7cd679-kube-api-access-hfthf\") pod \"monitoring-plugin-7b7b7bc8bf-5wpwk\" (UID: \"2a4bf924-cc08-4f1b-8b34-28881d7cd679\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5wpwk" Jul 21 18:31:52.512912 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.512879 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a4bf924-cc08-4f1b-8b34-28881d7cd679-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-5wpwk\" (UID: \"2a4bf924-cc08-4f1b-8b34-28881d7cd679\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5wpwk" Jul 21 18:31:52.520882 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.520840 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfthf\" (UniqueName: \"kubernetes.io/projected/2a4bf924-cc08-4f1b-8b34-28881d7cd679-kube-api-access-hfthf\") pod \"monitoring-plugin-7b7b7bc8bf-5wpwk\" (UID: \"2a4bf924-cc08-4f1b-8b34-28881d7cd679\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5wpwk" Jul 21 18:31:52.587862 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:52.587809 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5wpwk" Jul 21 18:31:53.146491 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.146448 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-959bf9d7b-zlhhc"] Jul 21 18:31:53.227124 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.227092 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k886l" Jul 21 18:31:53.837591 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.837554 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:31:53.857120 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.857084 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:31:53.862935 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.862910 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.876240 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.876211 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 21 18:31:53.876403 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.876362 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 21 18:31:53.877385 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.877177 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 21 18:31:53.877385 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.877192 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 21 18:31:53.877385 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.877219 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 21 18:31:53.877385 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.877237 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 21 18:31:53.877385 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.877343 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 21 18:31:53.877385 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.877352 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 21 18:31:53.877759 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.877425 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 21 18:31:53.877759 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.877448 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 21 18:31:53.877759 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.877464 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 21 18:31:53.877759 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.877469 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tspql\"" Jul 21 18:31:53.877759 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.877481 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 21 18:31:53.877759 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.877583 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9rr49n8mc4rav\"" Jul 21 18:31:53.889013 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.888824 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:31:53.889772 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.889748 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 21 18:31:53.889967 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.889941 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 21 18:31:53.921990 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.921953 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.921990 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922006 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922260 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922077 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922260 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922120 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922260 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922152 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922260 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922196 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922260 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922234 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-config\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922494 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922299 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1d539e9-841c-49b7-9c21-68f560e4efd8-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922494 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922340 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922494 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922385 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922494 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922411 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thg75\" (UniqueName: \"kubernetes.io/projected/f1d539e9-841c-49b7-9c21-68f560e4efd8-kube-api-access-thg75\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922494 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922445 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922494 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922470 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1d539e9-841c-49b7-9c21-68f560e4efd8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922781 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922518 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922781 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922566 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922781 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922597 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922781 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922623 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922781 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922649 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922781 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922676 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:53.922781 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:53.922698 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.023177 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.023128 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.023371 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.023194 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.023371 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.023232 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.023371 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.023257 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.023536 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.023394 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.023536 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.023431 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.023536 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.023469 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-config\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.023536 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.023512 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1d539e9-841c-49b7-9c21-68f560e4efd8-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.023737 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.023547 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.023737 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.023574 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.023737 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.023597 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thg75\" (UniqueName: \"kubernetes.io/projected/f1d539e9-841c-49b7-9c21-68f560e4efd8-kube-api-access-thg75\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.023737 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.023616 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.023737 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.023641 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1d539e9-841c-49b7-9c21-68f560e4efd8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.023737 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.023669 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.023737 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.023709 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.024430 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.024180 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.024430 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.024188 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.024430 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.024216 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.026881 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.026740 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.027394 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.027142 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.027394 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.027205 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.027394 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.027261 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.027394 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.027292 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.028412 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.028020 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.028913 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.028552 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.030136 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.029047 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.030136 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.029862 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.030307 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.030246 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.031496 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.030807 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.034241 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.032134 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1d539e9-841c-49b7-9c21-68f560e4efd8-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.034241 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.032214 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.034241 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.032562 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.034241 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.033088 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.034241 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.033506 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.035284 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.035260 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.036956 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.036406 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.036956 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.036807 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1d539e9-841c-49b7-9c21-68f560e4efd8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.038328 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.038011 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.040630 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.040611 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-config\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.059076 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.059050 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thg75\" (UniqueName: \"kubernetes.io/projected/f1d539e9-841c-49b7-9c21-68f560e4efd8-kube-api-access-thg75\") pod \"prometheus-k8s-0\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:54.175245 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:54.175159 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:31:55.152319 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:55.152169 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-597cf6959c-zhrhr"] Jul 21 18:31:55.154501 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:31:55.154460 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd334e0d5_185a_42fd_b391_88948ddd293c.slice/crio-67d633e3fd8191e6f542e5737107e79c1e8934f1b31fa8898768e6765dac12d6 WatchSource:0}: Error finding container 67d633e3fd8191e6f542e5737107e79c1e8934f1b31fa8898768e6765dac12d6: Status 404 returned error can't find the container with id 67d633e3fd8191e6f542e5737107e79c1e8934f1b31fa8898768e6765dac12d6 Jul 21 18:31:55.207864 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:55.207816 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5wpwk"] Jul 21 18:31:55.211780 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:31:55.211747 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a4bf924_cc08_4f1b_8b34_28881d7cd679.slice/crio-322436c8c4fefdb3c880d702616459e42019559f6709b3802433b5485236dff8 WatchSource:0}: Error finding container 322436c8c4fefdb3c880d702616459e42019559f6709b3802433b5485236dff8: Status 404 returned error can't find the container with id 322436c8c4fefdb3c880d702616459e42019559f6709b3802433b5485236dff8 Jul 21 18:31:55.312560 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:55.312527 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-55zgr" event={"ID":"84e00cf0-3628-4bac-9e53-69e4fec29d69","Type":"ContainerStarted","Data":"e5dbe5bf07941f213cd9b6cead12b6b9887d1f4035a78d950895d2f9886258c5"} Jul 21 18:31:55.314041 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:55.314010 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-khz8z" event={"ID":"7089390f-33ca-4e99-bb5c-0899bb33463d","Type":"ContainerStarted","Data":"98a1145aa2273de53d6852886fa2da469364c419c4821a563542010a22f1501a"} Jul 21 18:31:55.315139 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:55.315118 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5wpwk" event={"ID":"2a4bf924-cc08-4f1b-8b34-28881d7cd679","Type":"ContainerStarted","Data":"322436c8c4fefdb3c880d702616459e42019559f6709b3802433b5485236dff8"} Jul 21 18:31:55.316226 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:55.316201 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" event={"ID":"d334e0d5-185a-42fd-b391-88948ddd293c","Type":"ContainerStarted","Data":"67d633e3fd8191e6f542e5737107e79c1e8934f1b31fa8898768e6765dac12d6"} Jul 21 18:31:55.317422 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:55.317401 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d9kjr" event={"ID":"287e892d-0539-4cd6-91c9-13035bd0f542","Type":"ContainerStarted","Data":"866e0530011ad942d23ff7452227e2fde87e20dffcabed7332ae20fb9e9ae985"} Jul 21 18:31:55.317552 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:55.317443 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:31:55.319354 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:55.319322 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8l9zb" event={"ID":"4516a5a2-5ec8-4665-8c5c-77a4d809dcfb","Type":"ContainerStarted","Data":"a52f9daa5727f432397ef8797911f2ff0dbfb56a11a4f90ae7d4d3aa57f39271"} Jul 21 18:31:55.342392 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:55.342345 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-55zgr" podStartSLOduration=7.014970451 podStartE2EDuration="8.342330074s" totalImagesPullingTime="1.222859192s" totalInitContainerRuntime="104.500431ms" isStatefulPod=true podCreationTimestamp="2026-07-21 18:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:55.340984413 +0000 UTC m=+78.403064022" watchObservedRunningTime="2026-07-21 18:31:55.342330074 +0000 UTC m=+78.404409679" Jul 21 18:31:55.375535 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:55.375484 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8l9zb" podStartSLOduration=1.917853713 podStartE2EDuration="19.375467979s" totalImagesPullingTime="17.457614266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:31:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:55.37457855 +0000 UTC m=+78.436658159" watchObservedRunningTime="2026-07-21 18:31:55.375467979 +0000 UTC m=+78.437547587" Jul 21 18:31:55.392012 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:55.391985 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bc69b775-2s5jc"] Jul 21 18:31:55.397546 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:55.397503 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:31:55.397729 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:31:55.397702 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc854a5_5e90_4176_9be5_4b0f6ddc743d.slice/crio-73afcc4aff7abc6553001a81f2916a05255eb96a0e64c973bcd3a037dd9d8c38 WatchSource:0}: Error finding container 73afcc4aff7abc6553001a81f2916a05255eb96a0e64c973bcd3a037dd9d8c38: Status 404 returned error can't find the container with id 73afcc4aff7abc6553001a81f2916a05255eb96a0e64c973bcd3a037dd9d8c38 Jul 21 18:31:55.402036 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:31:55.402012 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1d539e9_841c_49b7_9c21_68f560e4efd8.slice/crio-a960aed9b01616bf1a9bce745ecb5d41359f412fb97ec18dbce17a17b9cc3b71 WatchSource:0}: Error finding container a960aed9b01616bf1a9bce745ecb5d41359f412fb97ec18dbce17a17b9cc3b71: Status 404 returned error can't find the container with id a960aed9b01616bf1a9bce745ecb5d41359f412fb97ec18dbce17a17b9cc3b71 Jul 21 18:31:55.402159 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:55.402025 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-d9kjr" podStartSLOduration=69.765119981 podStartE2EDuration="1m16.402006303s" totalImagesPullingTime="6.636886322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:55.401672257 +0000 UTC m=+78.463752064" watchObservedRunningTime="2026-07-21 18:31:55.402006303 +0000 UTC m=+78.464085912" Jul 21 18:31:55.425665 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:55.425586 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-khz8z" podStartSLOduration=69.788167642 podStartE2EDuration="1m16.425570328s" totalImagesPullingTime="6.637402686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:55.424870956 +0000 UTC m=+78.486950564" watchObservedRunningTime="2026-07-21 18:31:55.425570328 +0000 UTC m=+78.487649936" Jul 21 18:31:56.325275 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:56.325221 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d539e9-841c-49b7-9c21-68f560e4efd8","Type":"ContainerStarted","Data":"a960aed9b01616bf1a9bce745ecb5d41359f412fb97ec18dbce17a17b9cc3b71"} Jul 21 18:31:56.326950 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:56.326861 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" event={"ID":"1cc854a5-5e90-4176-9be5-4b0f6ddc743d","Type":"ContainerStarted","Data":"73afcc4aff7abc6553001a81f2916a05255eb96a0e64c973bcd3a037dd9d8c38"} Jul 21 18:31:58.338005 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:58.337957 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" event={"ID":"d334e0d5-185a-42fd-b391-88948ddd293c","Type":"ContainerStarted","Data":"561da522691805d3bd3b033010c560012b027832c6b5e112018fdf3680c3c1e5"} Jul 21 18:31:58.340010 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:58.339984 2556 generic.go:356] "Generic (PLEG): container finished" podID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerID="5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe" exitCode=0 Jul 21 18:31:58.340135 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:58.340065 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d539e9-841c-49b7-9c21-68f560e4efd8","Type":"ContainerDied","Data":"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe"} Jul 21 18:31:58.342406 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:58.342384 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" event={"ID":"1cc854a5-5e90-4176-9be5-4b0f6ddc743d","Type":"ContainerStarted","Data":"7980cea10583de228ff81e7b8dc6722353a27d8e7c4fbe05f70b989b509d2442"} Jul 21 18:31:58.342506 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:58.342453 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" event={"ID":"1cc854a5-5e90-4176-9be5-4b0f6ddc743d","Type":"ContainerStarted","Data":"3b3e6231c6acb6eb0039bfcc88ba1af0ae5e3b5c4a9f31d1c91e40901cdc6150"} Jul 21 18:31:58.342506 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:58.342496 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" event={"ID":"1cc854a5-5e90-4176-9be5-4b0f6ddc743d","Type":"ContainerStarted","Data":"f3f464db8122832e00fe4c4c6805208ae35a59e36e616e4041cfdbfe5ac19cf2"} Jul 21 18:31:58.344364 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:58.344343 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5wpwk" event={"ID":"2a4bf924-cc08-4f1b-8b34-28881d7cd679","Type":"ContainerStarted","Data":"0985d7fdc0702cf63d9aa7792e80e4b1c79080f3dff8a7de97b1b083a722f7e5"} Jul 21 18:31:58.344554 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:58.344540 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5wpwk" Jul 21 18:31:58.349486 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:58.349466 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5wpwk" Jul 21 18:31:58.367384 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:58.367341 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" podStartSLOduration=4.508608064 podStartE2EDuration="7.367326971s" totalImagesPullingTime="2.858718907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:31:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:58.365494275 +0000 UTC m=+81.427573896" watchObservedRunningTime="2026-07-21 18:31:58.367326971 +0000 UTC m=+81.429406557" Jul 21 18:31:58.392706 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:31:58.392658 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5wpwk" podStartSLOduration=3.587393025 podStartE2EDuration="6.392644248s" totalImagesPullingTime="2.805251223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:31:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:58.391977599 +0000 UTC m=+81.454057276" watchObservedRunningTime="2026-07-21 18:31:58.392644248 +0000 UTC m=+81.454723856" Jul 21 18:32:00.356815 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:00.356774 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" event={"ID":"1cc854a5-5e90-4176-9be5-4b0f6ddc743d","Type":"ContainerStarted","Data":"beeebfa2bba11f73fce7ea1ac38435d36eb2b92caccbad6542dc4cff547c2bbd"} Jul 21 18:32:00.357287 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:00.356882 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" event={"ID":"1cc854a5-5e90-4176-9be5-4b0f6ddc743d","Type":"ContainerStarted","Data":"25aef50840e458afacdd51208e2197ff89f092d2575111b4724c362d25b6f966"} Jul 21 18:32:00.357287 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:00.356929 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" event={"ID":"1cc854a5-5e90-4176-9be5-4b0f6ddc743d","Type":"ContainerStarted","Data":"ff144060f4d2992d250b25e432d719c5aae5989bba8b3b38702db28d258f3197"} Jul 21 18:32:00.357287 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:00.356973 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:32:00.394349 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:00.394295 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" podStartSLOduration=5.729901802 podStartE2EDuration="9.394278502s" totalImagesPullingTime="3.6643767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:31:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:32:00.39393282 +0000 UTC m=+83.456012432" watchObservedRunningTime="2026-07-21 18:32:00.394278502 +0000 UTC m=+83.456358110" Jul 21 18:32:02.370735 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:02.370692 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d539e9-841c-49b7-9c21-68f560e4efd8","Type":"ContainerStarted","Data":"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7"} Jul 21 18:32:02.371115 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:02.370812 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d539e9-841c-49b7-9c21-68f560e4efd8","Type":"ContainerStarted","Data":"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b"} Jul 21 18:32:02.371115 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:02.370881 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d539e9-841c-49b7-9c21-68f560e4efd8","Type":"ContainerStarted","Data":"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25"} Jul 21 18:32:02.371115 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:02.370920 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d539e9-841c-49b7-9c21-68f560e4efd8","Type":"ContainerStarted","Data":"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133"} Jul 21 18:32:02.371115 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:02.370957 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d539e9-841c-49b7-9c21-68f560e4efd8","Type":"ContainerStarted","Data":"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138"} Jul 21 18:32:02.371115 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:02.370993 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d539e9-841c-49b7-9c21-68f560e4efd8","Type":"ContainerStarted","Data":"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9"} Jul 21 18:32:02.412235 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:02.412187 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.537347091 podStartE2EDuration="9.41216473s" totalImagesPullingTime="5.845191637s" totalInitContainerRuntime="29.626002ms" isStatefulPod=false podCreationTimestamp="2026-07-21 18:31:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:32:02.410272393 +0000 UTC m=+85.472352000" watchObservedRunningTime="2026-07-21 18:32:02.41216473 +0000 UTC m=+85.474244340" Jul 21 18:32:04.175519 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:04.175479 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:32:06.370045 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:06.370012 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7bc69b775-2s5jc" Jul 21 18:32:12.383809 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:12.383756 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:32:12.384228 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:12.383835 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:32:18.168384 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:18.168314 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-959bf9d7b-zlhhc" podUID="87065a55-9201-4843-9862-591d50a9085b" containerName="console" containerID="cri-o://e5e553e5e71301d49f65ff83ad1358461c51254a748f631d1b713f08ec397995" gracePeriod=15 Jul 21 18:32:18.433018 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:18.432925 2556 generic.go:356] "Generic (PLEG): container finished" podID="87065a55-9201-4843-9862-591d50a9085b" containerID="e5e553e5e71301d49f65ff83ad1358461c51254a748f631d1b713f08ec397995" exitCode=0 Jul 21 18:32:18.433018 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:18.432999 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-959bf9d7b-zlhhc" event={"ID":"87065a55-9201-4843-9862-591d50a9085b","Type":"ContainerDied","Data":"e5e553e5e71301d49f65ff83ad1358461c51254a748f631d1b713f08ec397995"} Jul 21 18:32:18.992970 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:18.992945 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:32:19.149482 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.149392 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-console-config\") pod \"87065a55-9201-4843-9862-591d50a9085b\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " Jul 21 18:32:19.149482 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.149468 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/87065a55-9201-4843-9862-591d50a9085b-console-serving-cert\") pod \"87065a55-9201-4843-9862-591d50a9085b\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " Jul 21 18:32:19.149679 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.149605 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/87065a55-9201-4843-9862-591d50a9085b-console-oauth-config\") pod \"87065a55-9201-4843-9862-591d50a9085b\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " Jul 21 18:32:19.149679 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.149639 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-service-ca\") pod \"87065a55-9201-4843-9862-591d50a9085b\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " Jul 21 18:32:19.149771 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.149710 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-oauth-serving-cert\") pod \"87065a55-9201-4843-9862-591d50a9085b\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " Jul 21 18:32:19.149771 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.149746 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdnst\" (UniqueName: \"kubernetes.io/projected/87065a55-9201-4843-9862-591d50a9085b-kube-api-access-mdnst\") pod \"87065a55-9201-4843-9862-591d50a9085b\" (UID: \"87065a55-9201-4843-9862-591d50a9085b\") " Jul 21 18:32:19.149905 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.149887 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-console-config" (OuterVolumeSpecName: "console-config") pod "87065a55-9201-4843-9862-591d50a9085b" (UID: "87065a55-9201-4843-9862-591d50a9085b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:32:19.150077 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.150053 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-console-config\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:32:19.150215 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.150194 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-service-ca" (OuterVolumeSpecName: "service-ca") pod "87065a55-9201-4843-9862-591d50a9085b" (UID: "87065a55-9201-4843-9862-591d50a9085b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:32:19.150412 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.150385 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "87065a55-9201-4843-9862-591d50a9085b" (UID: "87065a55-9201-4843-9862-591d50a9085b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:32:19.151939 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.151911 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87065a55-9201-4843-9862-591d50a9085b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "87065a55-9201-4843-9862-591d50a9085b" (UID: "87065a55-9201-4843-9862-591d50a9085b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:32:19.152053 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.151988 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87065a55-9201-4843-9862-591d50a9085b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "87065a55-9201-4843-9862-591d50a9085b" (UID: "87065a55-9201-4843-9862-591d50a9085b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:32:19.152167 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.152147 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87065a55-9201-4843-9862-591d50a9085b-kube-api-access-mdnst" (OuterVolumeSpecName: "kube-api-access-mdnst") pod "87065a55-9201-4843-9862-591d50a9085b" (UID: "87065a55-9201-4843-9862-591d50a9085b"). InnerVolumeSpecName "kube-api-access-mdnst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:32:19.250676 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.250642 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/87065a55-9201-4843-9862-591d50a9085b-console-oauth-config\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:32:19.250676 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.250671 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-service-ca\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:32:19.250676 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.250681 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/87065a55-9201-4843-9862-591d50a9085b-oauth-serving-cert\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:32:19.251164 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.250690 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdnst\" (UniqueName: \"kubernetes.io/projected/87065a55-9201-4843-9862-591d50a9085b-kube-api-access-mdnst\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:32:19.251164 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.250700 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/87065a55-9201-4843-9862-591d50a9085b-console-serving-cert\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:32:19.438046 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.437964 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-959bf9d7b-zlhhc" event={"ID":"87065a55-9201-4843-9862-591d50a9085b","Type":"ContainerDied","Data":"bbde79767e2d42ce95c8547956395a9ffd2ef5e20fc8030919f69ebb7f22ea83"} Jul 21 18:32:19.438046 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.437998 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-959bf9d7b-zlhhc" Jul 21 18:32:19.438258 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.438058 2556 scope.go:117] "RemoveContainer" containerID="e5e553e5e71301d49f65ff83ad1358461c51254a748f631d1b713f08ec397995" Jul 21 18:32:19.460991 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.460967 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-959bf9d7b-zlhhc"] Jul 21 18:32:19.467181 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:19.467160 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-959bf9d7b-zlhhc"] Jul 21 18:32:20.980092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:20.980061 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87065a55-9201-4843-9862-591d50a9085b" path="/var/lib/kubelet/pods/87065a55-9201-4843-9862-591d50a9085b/volumes" Jul 21 18:32:26.329872 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:26.329827 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-d9kjr" Jul 21 18:32:32.176582 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:32.176529 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fmq2l_a2266407-4301-41ee-847b-7b648be92c94/serve-healthcheck-canary/0.log" Jul 21 18:32:32.388459 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:32.388429 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:32:32.392323 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:32.392294 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-597cf6959c-zhrhr" Jul 21 18:32:54.176343 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:54.176303 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:32:54.195990 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:54.195964 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:32:54.582840 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:32:54.582813 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.145715 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.145680 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:33:12.146282 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.145993 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="prometheus" containerID="cri-o://343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9" gracePeriod=600 Jul 21 18:33:12.146282 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.146014 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="kube-rbac-proxy" containerID="cri-o://748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b" gracePeriod=600 Jul 21 18:33:12.146282 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.146049 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="thanos-sidecar" containerID="cri-o://dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133" gracePeriod=600 Jul 21 18:33:12.146282 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.146086 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7" gracePeriod=600 Jul 21 18:33:12.146282 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.146198 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="kube-rbac-proxy-web" containerID="cri-o://95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25" gracePeriod=600 Jul 21 18:33:12.146282 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.146222 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="config-reloader" containerID="cri-o://9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138" gracePeriod=600 Jul 21 18:33:12.401793 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.401727 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.495082 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495045 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-trusted-ca-bundle\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.495265 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495090 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1d539e9-841c-49b7-9c21-68f560e4efd8-tls-assets\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.495265 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495122 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-kubelet-serving-ca-bundle\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.495265 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495147 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thg75\" (UniqueName: \"kubernetes.io/projected/f1d539e9-841c-49b7-9c21-68f560e4efd8-kube-api-access-thg75\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.495265 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495170 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-grpc-tls\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.495265 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495193 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-tls\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.495265 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495218 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-0\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.495568 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495460 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:33:12.495625 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495596 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:33:12.495682 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495619 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-serving-certs-ca-bundle\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.495733 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495678 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-metrics-client-ca\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.495733 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495710 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-1\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.495827 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495746 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-db\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.495827 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495769 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-kube-rbac-proxy\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.495827 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495796 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-2\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.496003 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495837 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-web-config\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.496003 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495887 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-thanos-prometheus-http-client-file\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.496003 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495890 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:33:12.496003 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495913 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.496003 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495943 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1d539e9-841c-49b7-9c21-68f560e4efd8-config-out\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.496003 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.495969 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.496003 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.496000 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-config\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.496338 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.496036 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-metrics-client-certs\") pod \"f1d539e9-841c-49b7-9c21-68f560e4efd8\" (UID: \"f1d539e9-841c-49b7-9c21-68f560e4efd8\") " Jul 21 18:33:12.496338 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.496289 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.496338 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.496313 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.496338 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.496320 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:33:12.496539 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.496328 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.497575 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.497284 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:33:12.498223 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.497743 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:33:12.498223 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.498122 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:33:12.498529 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.498474 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:33:12.498893 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.498830 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:33:12.499011 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.498956 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:33:12.499483 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.499452 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:33:12.499588 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.499559 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:33:12.499650 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.499622 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1d539e9-841c-49b7-9c21-68f560e4efd8-kube-api-access-thg75" (OuterVolumeSpecName: "kube-api-access-thg75") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "kube-api-access-thg75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:33:12.499702 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.499646 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1d539e9-841c-49b7-9c21-68f560e4efd8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:33:12.499873 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.499829 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:33:12.500546 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.500527 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:33:12.500837 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.500818 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-config" (OuterVolumeSpecName: "config") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:33:12.500946 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.500873 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1d539e9-841c-49b7-9c21-68f560e4efd8-config-out" (OuterVolumeSpecName: "config-out") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:33:12.501225 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.501206 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:33:12.509677 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.509657 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-web-config" (OuterVolumeSpecName: "web-config") pod "f1d539e9-841c-49b7-9c21-68f560e4efd8" (UID: "f1d539e9-841c-49b7-9c21-68f560e4efd8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:33:12.596779 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.596734 2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1d539e9-841c-49b7-9c21-68f560e4efd8-config-out\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.596779 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.596772 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.596779 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.596784 2556 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-config\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.596779 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.596793 2556 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-metrics-client-certs\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.597056 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.596802 2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1d539e9-841c-49b7-9c21-68f560e4efd8-tls-assets\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.597056 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.596810 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thg75\" (UniqueName: \"kubernetes.io/projected/f1d539e9-841c-49b7-9c21-68f560e4efd8-kube-api-access-thg75\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.597056 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.596818 2556 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-grpc-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.597056 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.596827 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.597056 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.596835 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.597056 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.596865 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-configmap-metrics-client-ca\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.597056 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.596873 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.597056 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.596881 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-db\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.597056 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.596890 2556 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-kube-rbac-proxy\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.597056 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.596898 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f1d539e9-841c-49b7-9c21-68f560e4efd8-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.597056 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.596906 2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-web-config\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.597056 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.596914 2556 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.597056 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.596922 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1d539e9-841c-49b7-9c21-68f560e4efd8-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:33:12.637682 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.637650 2556 generic.go:356] "Generic (PLEG): container finished" podID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerID="6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7" exitCode=0 Jul 21 18:33:12.637682 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.637678 2556 generic.go:356] "Generic (PLEG): container finished" podID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerID="748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b" exitCode=0 Jul 21 18:33:12.637682 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.637685 2556 generic.go:356] "Generic (PLEG): container finished" podID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerID="95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25" exitCode=0 Jul 21 18:33:12.637911 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.637691 2556 generic.go:356] "Generic (PLEG): container finished" podID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerID="dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133" exitCode=0 Jul 21 18:33:12.637911 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.637697 2556 generic.go:356] "Generic (PLEG): container finished" podID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerID="9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138" exitCode=0 Jul 21 18:33:12.637911 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.637702 2556 generic.go:356] "Generic (PLEG): container finished" podID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerID="343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9" exitCode=0 Jul 21 18:33:12.637911 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.637717 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.637911 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.637741 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d539e9-841c-49b7-9c21-68f560e4efd8","Type":"ContainerDied","Data":"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7"} Jul 21 18:33:12.637911 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.637811 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d539e9-841c-49b7-9c21-68f560e4efd8","Type":"ContainerDied","Data":"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b"} Jul 21 18:33:12.637911 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.637838 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d539e9-841c-49b7-9c21-68f560e4efd8","Type":"ContainerDied","Data":"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25"} Jul 21 18:33:12.637911 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.637866 2556 scope.go:117] "RemoveContainer" containerID="6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7" Jul 21 18:33:12.637911 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.637877 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d539e9-841c-49b7-9c21-68f560e4efd8","Type":"ContainerDied","Data":"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133"} Jul 21 18:33:12.637911 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.637901 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d539e9-841c-49b7-9c21-68f560e4efd8","Type":"ContainerDied","Data":"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138"} Jul 21 18:33:12.638359 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.637926 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d539e9-841c-49b7-9c21-68f560e4efd8","Type":"ContainerDied","Data":"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9"} Jul 21 18:33:12.638359 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.637950 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d539e9-841c-49b7-9c21-68f560e4efd8","Type":"ContainerDied","Data":"a960aed9b01616bf1a9bce745ecb5d41359f412fb97ec18dbce17a17b9cc3b71"} Jul 21 18:33:12.645714 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.645691 2556 scope.go:117] "RemoveContainer" containerID="748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b" Jul 21 18:33:12.652903 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.652882 2556 scope.go:117] "RemoveContainer" containerID="95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25" Jul 21 18:33:12.659203 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.659187 2556 scope.go:117] "RemoveContainer" containerID="dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133" Jul 21 18:33:12.665237 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.665216 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:33:12.665941 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.665926 2556 scope.go:117] "RemoveContainer" containerID="9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138" Jul 21 18:33:12.674924 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.673928 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:33:12.677520 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.677491 2556 scope.go:117] "RemoveContainer" containerID="343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9" Jul 21 18:33:12.684601 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.684578 2556 scope.go:117] "RemoveContainer" containerID="5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe" Jul 21 18:33:12.691320 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.691304 2556 scope.go:117] "RemoveContainer" containerID="6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7" Jul 21 18:33:12.691578 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:33:12.691560 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7\": container with ID starting with 6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7 not found: ID does not exist" containerID="6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7" Jul 21 18:33:12.691625 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.691586 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7"} err="failed to get container status \"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7\": rpc error: code = NotFound desc = could not find container \"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7\": container with ID starting with 6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7 not found: ID does not exist" Jul 21 18:33:12.691625 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.691618 2556 scope.go:117] "RemoveContainer" containerID="748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b" Jul 21 18:33:12.691875 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:33:12.691834 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b\": container with ID starting with 748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b not found: ID does not exist" containerID="748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b" Jul 21 18:33:12.691972 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.691880 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b"} err="failed to get container status \"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b\": rpc error: code = NotFound desc = could not find container \"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b\": container with ID starting with 748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b not found: ID does not exist" Jul 21 18:33:12.691972 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.691898 2556 scope.go:117] "RemoveContainer" containerID="95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25" Jul 21 18:33:12.692118 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:33:12.692097 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25\": container with ID starting with 95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25 not found: ID does not exist" containerID="95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25" Jul 21 18:33:12.692153 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.692122 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25"} err="failed to get container status \"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25\": rpc error: code = NotFound desc = could not find container \"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25\": container with ID starting with 95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25 not found: ID does not exist" Jul 21 18:33:12.692153 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.692135 2556 scope.go:117] "RemoveContainer" containerID="dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133" Jul 21 18:33:12.692352 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:33:12.692330 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133\": container with ID starting with dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133 not found: ID does not exist" containerID="dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133" Jul 21 18:33:12.692399 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.692356 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133"} err="failed to get container status \"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133\": rpc error: code = NotFound desc = could not find container \"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133\": container with ID starting with dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133 not found: ID does not exist" Jul 21 18:33:12.692399 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.692370 2556 scope.go:117] "RemoveContainer" containerID="9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138" Jul 21 18:33:12.692592 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:33:12.692577 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138\": container with ID starting with 9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138 not found: ID does not exist" containerID="9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138" Jul 21 18:33:12.692633 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.692596 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138"} err="failed to get container status \"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138\": rpc error: code = NotFound desc = could not find container \"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138\": container with ID starting with 9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138 not found: ID does not exist" Jul 21 18:33:12.692633 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.692608 2556 scope.go:117] "RemoveContainer" containerID="343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9" Jul 21 18:33:12.692872 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:33:12.692839 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9\": container with ID starting with 343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9 not found: ID does not exist" containerID="343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9" Jul 21 18:33:12.692945 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.692877 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9"} err="failed to get container status \"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9\": rpc error: code = NotFound desc = could not find container \"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9\": container with ID starting with 343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9 not found: ID does not exist" Jul 21 18:33:12.692945 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.692891 2556 scope.go:117] "RemoveContainer" containerID="5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe" Jul 21 18:33:12.693097 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:33:12.693079 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe\": container with ID starting with 5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe not found: ID does not exist" containerID="5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe" Jul 21 18:33:12.693136 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.693102 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe"} err="failed to get container status \"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe\": rpc error: code = NotFound desc = could not find container \"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe\": container with ID starting with 5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe not found: ID does not exist" Jul 21 18:33:12.693136 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.693115 2556 scope.go:117] "RemoveContainer" containerID="6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7" Jul 21 18:33:12.693341 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.693325 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7"} err="failed to get container status \"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7\": rpc error: code = NotFound desc = could not find container \"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7\": container with ID starting with 6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7 not found: ID does not exist" Jul 21 18:33:12.693341 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.693341 2556 scope.go:117] "RemoveContainer" containerID="748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b" Jul 21 18:33:12.693544 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.693530 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b"} err="failed to get container status \"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b\": rpc error: code = NotFound desc = could not find container \"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b\": container with ID starting with 748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b not found: ID does not exist" Jul 21 18:33:12.693586 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.693544 2556 scope.go:117] "RemoveContainer" containerID="95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25" Jul 21 18:33:12.693732 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.693715 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25"} err="failed to get container status \"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25\": rpc error: code = NotFound desc = could not find container \"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25\": container with ID starting with 95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25 not found: ID does not exist" Jul 21 18:33:12.693774 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.693733 2556 scope.go:117] "RemoveContainer" containerID="dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133" Jul 21 18:33:12.693951 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.693935 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133"} err="failed to get container status \"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133\": rpc error: code = NotFound desc = could not find container \"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133\": container with ID starting with dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133 not found: ID does not exist" Jul 21 18:33:12.693951 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.693950 2556 scope.go:117] "RemoveContainer" containerID="9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138" Jul 21 18:33:12.694163 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.694146 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138"} err="failed to get container status \"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138\": rpc error: code = NotFound desc = could not find container \"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138\": container with ID starting with 9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138 not found: ID does not exist" Jul 21 18:33:12.694163 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.694163 2556 scope.go:117] "RemoveContainer" containerID="343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9" Jul 21 18:33:12.694340 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.694325 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9"} err="failed to get container status \"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9\": rpc error: code = NotFound desc = could not find container \"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9\": container with ID starting with 343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9 not found: ID does not exist" Jul 21 18:33:12.694340 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.694339 2556 scope.go:117] "RemoveContainer" containerID="5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe" Jul 21 18:33:12.694530 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.694513 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe"} err="failed to get container status \"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe\": rpc error: code = NotFound desc = could not find container \"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe\": container with ID starting with 5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe not found: ID does not exist" Jul 21 18:33:12.694593 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.694530 2556 scope.go:117] "RemoveContainer" containerID="6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7" Jul 21 18:33:12.694742 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.694726 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7"} err="failed to get container status \"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7\": rpc error: code = NotFound desc = could not find container \"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7\": container with ID starting with 6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7 not found: ID does not exist" Jul 21 18:33:12.694742 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.694741 2556 scope.go:117] "RemoveContainer" containerID="748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b" Jul 21 18:33:12.694973 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.694958 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b"} err="failed to get container status \"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b\": rpc error: code = NotFound desc = could not find container \"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b\": container with ID starting with 748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b not found: ID does not exist" Jul 21 18:33:12.695029 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.694974 2556 scope.go:117] "RemoveContainer" containerID="95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25" Jul 21 18:33:12.695190 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.695173 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25"} err="failed to get container status \"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25\": rpc error: code = NotFound desc = could not find container \"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25\": container with ID starting with 95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25 not found: ID does not exist" Jul 21 18:33:12.695233 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.695191 2556 scope.go:117] "RemoveContainer" containerID="dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133" Jul 21 18:33:12.695393 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.695373 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133"} err="failed to get container status \"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133\": rpc error: code = NotFound desc = could not find container \"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133\": container with ID starting with dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133 not found: ID does not exist" Jul 21 18:33:12.695443 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.695394 2556 scope.go:117] "RemoveContainer" containerID="9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138" Jul 21 18:33:12.695604 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.695584 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138"} err="failed to get container status \"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138\": rpc error: code = NotFound desc = could not find container \"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138\": container with ID starting with 9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138 not found: ID does not exist" Jul 21 18:33:12.695645 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.695605 2556 scope.go:117] "RemoveContainer" containerID="343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9" Jul 21 18:33:12.695800 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.695783 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9"} err="failed to get container status \"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9\": rpc error: code = NotFound desc = could not find container \"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9\": container with ID starting with 343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9 not found: ID does not exist" Jul 21 18:33:12.695874 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.695801 2556 scope.go:117] "RemoveContainer" containerID="5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe" Jul 21 18:33:12.696031 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.696013 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe"} err="failed to get container status \"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe\": rpc error: code = NotFound desc = could not find container \"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe\": container with ID starting with 5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe not found: ID does not exist" Jul 21 18:33:12.696077 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.696030 2556 scope.go:117] "RemoveContainer" containerID="6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7" Jul 21 18:33:12.696232 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.696213 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7"} err="failed to get container status \"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7\": rpc error: code = NotFound desc = could not find container \"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7\": container with ID starting with 6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7 not found: ID does not exist" Jul 21 18:33:12.696282 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.696233 2556 scope.go:117] "RemoveContainer" containerID="748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b" Jul 21 18:33:12.696441 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.696424 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b"} err="failed to get container status \"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b\": rpc error: code = NotFound desc = could not find container \"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b\": container with ID starting with 748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b not found: ID does not exist" Jul 21 18:33:12.696489 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.696441 2556 scope.go:117] "RemoveContainer" containerID="95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25" Jul 21 18:33:12.696653 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.696637 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25"} err="failed to get container status \"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25\": rpc error: code = NotFound desc = could not find container \"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25\": container with ID starting with 95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25 not found: ID does not exist" Jul 21 18:33:12.696696 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.696655 2556 scope.go:117] "RemoveContainer" containerID="dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133" Jul 21 18:33:12.696864 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.696831 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133"} err="failed to get container status \"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133\": rpc error: code = NotFound desc = could not find container \"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133\": container with ID starting with dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133 not found: ID does not exist" Jul 21 18:33:12.696920 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.696877 2556 scope.go:117] "RemoveContainer" containerID="9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138" Jul 21 18:33:12.697105 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.697090 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138"} err="failed to get container status \"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138\": rpc error: code = NotFound desc = could not find container \"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138\": container with ID starting with 9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138 not found: ID does not exist" Jul 21 18:33:12.697148 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.697106 2556 scope.go:117] "RemoveContainer" containerID="343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9" Jul 21 18:33:12.697337 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.697315 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9"} err="failed to get container status \"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9\": rpc error: code = NotFound desc = could not find container \"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9\": container with ID starting with 343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9 not found: ID does not exist" Jul 21 18:33:12.697337 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.697337 2556 scope.go:117] "RemoveContainer" containerID="5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe" Jul 21 18:33:12.697628 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.697600 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe"} err="failed to get container status \"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe\": rpc error: code = NotFound desc = could not find container \"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe\": container with ID starting with 5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe not found: ID does not exist" Jul 21 18:33:12.697628 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.697626 2556 scope.go:117] "RemoveContainer" containerID="6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7" Jul 21 18:33:12.697910 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.697884 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7"} err="failed to get container status \"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7\": rpc error: code = NotFound desc = could not find container \"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7\": container with ID starting with 6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7 not found: ID does not exist" Jul 21 18:33:12.697910 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.697910 2556 scope.go:117] "RemoveContainer" containerID="748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b" Jul 21 18:33:12.698126 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.698106 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b"} err="failed to get container status \"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b\": rpc error: code = NotFound desc = could not find container \"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b\": container with ID starting with 748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b not found: ID does not exist" Jul 21 18:33:12.698214 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.698126 2556 scope.go:117] "RemoveContainer" containerID="95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25" Jul 21 18:33:12.698363 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.698339 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25"} err="failed to get container status \"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25\": rpc error: code = NotFound desc = could not find container \"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25\": container with ID starting with 95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25 not found: ID does not exist" Jul 21 18:33:12.698451 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.698364 2556 scope.go:117] "RemoveContainer" containerID="dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133" Jul 21 18:33:12.698715 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.698685 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133"} err="failed to get container status \"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133\": rpc error: code = NotFound desc = could not find container \"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133\": container with ID starting with dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133 not found: ID does not exist" Jul 21 18:33:12.698715 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.698705 2556 scope.go:117] "RemoveContainer" containerID="9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138" Jul 21 18:33:12.699012 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.698989 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138"} err="failed to get container status \"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138\": rpc error: code = NotFound desc = could not find container \"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138\": container with ID starting with 9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138 not found: ID does not exist" Jul 21 18:33:12.699087 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699014 2556 scope.go:117] "RemoveContainer" containerID="343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9" Jul 21 18:33:12.699306 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699285 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9"} err="failed to get container status \"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9\": rpc error: code = NotFound desc = could not find container \"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9\": container with ID starting with 343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9 not found: ID does not exist" Jul 21 18:33:12.699357 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699308 2556 scope.go:117] "RemoveContainer" containerID="5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe" Jul 21 18:33:12.699406 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699392 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:33:12.699563 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699545 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe"} err="failed to get container status \"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe\": rpc error: code = NotFound desc = could not find container \"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe\": container with ID starting with 5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe not found: ID does not exist" Jul 21 18:33:12.699610 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699563 2556 scope.go:117] "RemoveContainer" containerID="6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7" Jul 21 18:33:12.699693 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699679 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="thanos-sidecar" Jul 21 18:33:12.699731 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699698 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="thanos-sidecar" Jul 21 18:33:12.699731 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699719 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="kube-rbac-proxy" Jul 21 18:33:12.699731 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699728 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="kube-rbac-proxy" Jul 21 18:33:12.699830 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699741 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="prometheus" Jul 21 18:33:12.699830 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699750 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="prometheus" Jul 21 18:33:12.699830 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699761 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="kube-rbac-proxy-web" Jul 21 18:33:12.699830 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699770 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="kube-rbac-proxy-web" Jul 21 18:33:12.699830 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699779 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="kube-rbac-proxy-thanos" Jul 21 18:33:12.699830 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699788 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="kube-rbac-proxy-thanos" Jul 21 18:33:12.699830 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699783 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7"} err="failed to get container status \"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7\": rpc error: code = NotFound desc = could not find container \"6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7\": container with ID starting with 6dce4bd01bb0c9ca91fe347d623f066dde73c97df899edf939851886add293d7 not found: ID does not exist" Jul 21 18:33:12.699830 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699799 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="init-config-reloader" Jul 21 18:33:12.699830 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699802 2556 scope.go:117] "RemoveContainer" containerID="748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b" Jul 21 18:33:12.699830 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699807 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="init-config-reloader" Jul 21 18:33:12.699830 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699817 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87065a55-9201-4843-9862-591d50a9085b" containerName="console" Jul 21 18:33:12.699830 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699825 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="87065a55-9201-4843-9862-591d50a9085b" containerName="console" Jul 21 18:33:12.699830 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699833 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="config-reloader" Jul 21 18:33:12.700271 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699878 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="config-reloader" Jul 21 18:33:12.700271 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699948 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="prometheus" Jul 21 18:33:12.700271 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699956 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="config-reloader" Jul 21 18:33:12.700271 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699961 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="kube-rbac-proxy-thanos" Jul 21 18:33:12.700271 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699969 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="thanos-sidecar" Jul 21 18:33:12.700271 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699974 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="kube-rbac-proxy-web" Jul 21 18:33:12.700271 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699982 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" containerName="kube-rbac-proxy" Jul 21 18:33:12.700271 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.699988 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="87065a55-9201-4843-9862-591d50a9085b" containerName="console" Jul 21 18:33:12.700271 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.700069 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b"} err="failed to get container status \"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b\": rpc error: code = NotFound desc = could not find container \"748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b\": container with ID starting with 748ad27cfe57c2a0f65233b5ad5bd21ceb3e6456d3501bacbe4d90669ad77b9b not found: ID does not exist" Jul 21 18:33:12.700271 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.700082 2556 scope.go:117] "RemoveContainer" containerID="95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25" Jul 21 18:33:12.700587 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.700328 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25"} err="failed to get container status \"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25\": rpc error: code = NotFound desc = could not find container \"95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25\": container with ID starting with 95557a42d250ba89331a4f6dd9032302e9b0b378842a6c34be845737c6718b25 not found: ID does not exist" Jul 21 18:33:12.700587 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.700348 2556 scope.go:117] "RemoveContainer" containerID="dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133" Jul 21 18:33:12.700587 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.700539 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133"} err="failed to get container status \"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133\": rpc error: code = NotFound desc = could not find container \"dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133\": container with ID starting with dc40b119865655a03e6e174cbfdeaaab7a00652b8140d3e8a774798a64ec6133 not found: ID does not exist" Jul 21 18:33:12.700587 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.700557 2556 scope.go:117] "RemoveContainer" containerID="9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138" Jul 21 18:33:12.700776 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.700755 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138"} err="failed to get container status \"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138\": rpc error: code = NotFound desc = could not find container \"9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138\": container with ID starting with 9c895a8e95dd939b851fbde3f11f5d6c0de9a406dd7b9a2e817cf3b866dfe138 not found: ID does not exist" Jul 21 18:33:12.700815 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.700777 2556 scope.go:117] "RemoveContainer" containerID="343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9" Jul 21 18:33:12.700966 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.700951 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9"} err="failed to get container status \"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9\": rpc error: code = NotFound desc = could not find container \"343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9\": container with ID starting with 343169ee016f2720200ebc7545dd9fb13d95588cbf011657d987ea29935298d9 not found: ID does not exist" Jul 21 18:33:12.701009 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.700968 2556 scope.go:117] "RemoveContainer" containerID="5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe" Jul 21 18:33:12.701165 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.701146 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe"} err="failed to get container status \"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe\": rpc error: code = NotFound desc = could not find container \"5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe\": container with ID starting with 5189ae34340523cc3756cac2f2812d9260c3d6d6e8d88c729aaa1f8735440ffe not found: ID does not exist" Jul 21 18:33:12.704745 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.704730 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.707341 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.707321 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 21 18:33:12.708113 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.708094 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 21 18:33:12.708268 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.708243 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 21 18:33:12.708567 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.708550 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 21 18:33:12.708761 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.708745 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tspql\"" Jul 21 18:33:12.708830 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.708759 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 21 18:33:12.708830 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.708787 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 21 18:33:12.708955 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.708872 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 21 18:33:12.709070 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.709056 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 21 18:33:12.709982 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.709965 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9rr49n8mc4rav\"" Jul 21 18:33:12.710073 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.709983 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 21 18:33:12.710172 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.710147 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 21 18:33:12.710362 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.710282 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 21 18:33:12.710362 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.710290 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 21 18:33:12.713461 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.713442 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 21 18:33:12.714554 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.714537 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 21 18:33:12.720767 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.720746 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:33:12.798538 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.798496 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.798538 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.798540 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.798820 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.798618 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.798820 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.798660 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.798820 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.798686 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-web-config\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.798820 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.798715 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-config\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.798820 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.798737 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.798820 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.798761 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.798820 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.798785 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/77aa2839-3228-45e5-89b2-efaa645df588-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.799092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.798862 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.799092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.798898 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.799092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.798919 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcgch\" (UniqueName: \"kubernetes.io/projected/77aa2839-3228-45e5-89b2-efaa645df588-kube-api-access-tcgch\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.799092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.798944 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/77aa2839-3228-45e5-89b2-efaa645df588-config-out\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.799092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.799002 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.799092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.799027 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.799092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.799050 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.799092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.799070 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.799092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.799084 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.799380 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.799139 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/77aa2839-3228-45e5-89b2-efaa645df588-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.799380 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.799154 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900160 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900107 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900160 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900159 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcgch\" (UniqueName: \"kubernetes.io/projected/77aa2839-3228-45e5-89b2-efaa645df588-kube-api-access-tcgch\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900417 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900187 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/77aa2839-3228-45e5-89b2-efaa645df588-config-out\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900417 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900218 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900417 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900244 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900417 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900267 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900417 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900295 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900417 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900316 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900417 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900353 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/77aa2839-3228-45e5-89b2-efaa645df588-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900417 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900375 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900417 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900413 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900837 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900436 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900837 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900481 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900837 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900506 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900837 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900528 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-web-config\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900837 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900558 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-config\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900837 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900582 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900837 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900610 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900837 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900633 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/77aa2839-3228-45e5-89b2-efaa645df588-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.900837 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.900669 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.901381 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.901354 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.901453 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.901420 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.902507 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.901992 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.904507 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.903320 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.904507 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.903444 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.904507 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.903460 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.904507 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.903539 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.904507 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.903703 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.904507 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.903782 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/77aa2839-3228-45e5-89b2-efaa645df588-config-out\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.904507 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.904119 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.904507 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.904234 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.904507 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.904400 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.905047 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.904521 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/77aa2839-3228-45e5-89b2-efaa645df588-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.905047 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.904934 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/77aa2839-3228-45e5-89b2-efaa645df588-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.905336 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.905309 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/77aa2839-3228-45e5-89b2-efaa645df588-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.905675 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.905658 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-web-config\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.905804 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.905787 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.906303 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.906281 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.906303 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.906300 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/77aa2839-3228-45e5-89b2-efaa645df588-config\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.908489 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.908469 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcgch\" (UniqueName: \"kubernetes.io/projected/77aa2839-3228-45e5-89b2-efaa645df588-kube-api-access-tcgch\") pod \"prometheus-k8s-0\" (UID: \"77aa2839-3228-45e5-89b2-efaa645df588\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:12.979547 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:12.979516 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1d539e9-841c-49b7-9c21-68f560e4efd8" path="/var/lib/kubelet/pods/f1d539e9-841c-49b7-9c21-68f560e4efd8/volumes" Jul 21 18:33:13.014118 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:13.014086 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:33:13.146067 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:13.146042 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:33:13.148335 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:33:13.148310 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77aa2839_3228_45e5_89b2_efaa645df588.slice/crio-9b7f17174efe000b341124a0f338a9787e6bea7aea1c210acce4a3c9eceea2f9 WatchSource:0}: Error finding container 9b7f17174efe000b341124a0f338a9787e6bea7aea1c210acce4a3c9eceea2f9: Status 404 returned error can't find the container with id 9b7f17174efe000b341124a0f338a9787e6bea7aea1c210acce4a3c9eceea2f9 Jul 21 18:33:13.643034 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:13.642993 2556 generic.go:356] "Generic (PLEG): container finished" podID="77aa2839-3228-45e5-89b2-efaa645df588" containerID="7c7afa88c91499c088c837bc7dfb9563e2e771563025707b512dba15c59e2c28" exitCode=0 Jul 21 18:33:13.643211 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:13.643071 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77aa2839-3228-45e5-89b2-efaa645df588","Type":"ContainerDied","Data":"7c7afa88c91499c088c837bc7dfb9563e2e771563025707b512dba15c59e2c28"} Jul 21 18:33:13.643211 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:13.643135 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77aa2839-3228-45e5-89b2-efaa645df588","Type":"ContainerStarted","Data":"9b7f17174efe000b341124a0f338a9787e6bea7aea1c210acce4a3c9eceea2f9"} Jul 21 18:33:14.650780 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:14.650739 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77aa2839-3228-45e5-89b2-efaa645df588","Type":"ContainerStarted","Data":"54b2b2eab65bc31cb579857bdb14bac5992c2d687d034a063dd768da86396e9d"} Jul 21 18:33:14.651203 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:14.650877 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77aa2839-3228-45e5-89b2-efaa645df588","Type":"ContainerStarted","Data":"1e6f0a19425cc1e5cfe8714e828b61a98c3efbb0b49da50bea44ce591844113c"} Jul 21 18:33:14.651203 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:14.650928 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77aa2839-3228-45e5-89b2-efaa645df588","Type":"ContainerStarted","Data":"cdd654e42cb1f13d9697243e047b307d62ec7291888e7607417675fd434b8b1c"} Jul 21 18:33:14.651203 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:14.650965 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77aa2839-3228-45e5-89b2-efaa645df588","Type":"ContainerStarted","Data":"c6dffc678ff6eaf67ce6207d3966a36e2699d06dc0e9bf2b18c5629f2533400a"} Jul 21 18:33:14.651203 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:14.650999 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77aa2839-3228-45e5-89b2-efaa645df588","Type":"ContainerStarted","Data":"ad1a9efc8c5fa3ca2c330594889631d83f75cfc5b8da91ad93c6fa8d978ebe98"} Jul 21 18:33:14.651203 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:14.651035 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77aa2839-3228-45e5-89b2-efaa645df588","Type":"ContainerStarted","Data":"8e196328048ec0dffa04ffd63d96b2eb53b144da504cebcfb5ba9e810f428f4b"} Jul 21 18:33:14.678197 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:14.678129 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.657988195 podStartE2EDuration="2.678096493s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.108298ms" isStatefulPod=false podCreationTimestamp="2026-07-21 18:33:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:33:14.676754496 +0000 UTC m=+157.738834107" watchObservedRunningTime="2026-07-21 18:33:14.678096493 +0000 UTC m=+157.740176103" Jul 21 18:33:18.014404 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:33:18.014347 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:34:13.015242 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:34:13.015197 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:34:13.030360 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:34:13.030329 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:34:13.875135 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:34:13.875107 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:35:38.849319 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:35:38.849292 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 21 18:38:21.287747 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.287710 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fff764dd4-vmhff"] Jul 21 18:38:21.289948 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.289931 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.293365 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.293338 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 21 18:38:21.294391 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.294370 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 21 18:38:21.294525 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.294415 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 21 18:38:21.294525 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.294447 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 21 18:38:21.294525 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.294388 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 21 18:38:21.294525 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.294389 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cxgbh\"" Jul 21 18:38:21.294682 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.294388 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 21 18:38:21.295454 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.295426 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 21 18:38:21.300802 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.300785 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 21 18:38:21.303787 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.303767 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fff764dd4-vmhff"] Jul 21 18:38:21.362572 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.362533 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc1bb4a4-4969-418f-813e-19de4a9c93e6-console-serving-cert\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.362783 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.362578 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljh5k\" (UniqueName: \"kubernetes.io/projected/bc1bb4a4-4969-418f-813e-19de4a9c93e6-kube-api-access-ljh5k\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.362783 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.362697 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc1bb4a4-4969-418f-813e-19de4a9c93e6-console-oauth-config\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.362783 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.362742 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1bb4a4-4969-418f-813e-19de4a9c93e6-trusted-ca-bundle\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.362783 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.362770 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc1bb4a4-4969-418f-813e-19de4a9c93e6-console-config\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.362981 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.362803 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc1bb4a4-4969-418f-813e-19de4a9c93e6-oauth-serving-cert\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.363072 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.362982 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc1bb4a4-4969-418f-813e-19de4a9c93e6-service-ca\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.464188 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.464155 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc1bb4a4-4969-418f-813e-19de4a9c93e6-service-ca\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.464433 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.464198 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc1bb4a4-4969-418f-813e-19de4a9c93e6-console-serving-cert\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.464433 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.464219 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljh5k\" (UniqueName: \"kubernetes.io/projected/bc1bb4a4-4969-418f-813e-19de4a9c93e6-kube-api-access-ljh5k\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.464433 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.464248 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc1bb4a4-4969-418f-813e-19de4a9c93e6-console-oauth-config\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.464433 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.464265 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1bb4a4-4969-418f-813e-19de4a9c93e6-trusted-ca-bundle\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.464433 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.464282 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc1bb4a4-4969-418f-813e-19de4a9c93e6-console-config\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.464433 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.464301 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc1bb4a4-4969-418f-813e-19de4a9c93e6-oauth-serving-cert\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.465016 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.464987 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc1bb4a4-4969-418f-813e-19de4a9c93e6-service-ca\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.465173 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.465152 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc1bb4a4-4969-418f-813e-19de4a9c93e6-console-config\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.465221 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.465167 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc1bb4a4-4969-418f-813e-19de4a9c93e6-oauth-serving-cert\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.465256 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.465245 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1bb4a4-4969-418f-813e-19de4a9c93e6-trusted-ca-bundle\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.466775 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.466755 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc1bb4a4-4969-418f-813e-19de4a9c93e6-console-oauth-config\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.466894 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.466806 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc1bb4a4-4969-418f-813e-19de4a9c93e6-console-serving-cert\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.473720 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.473696 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljh5k\" (UniqueName: \"kubernetes.io/projected/bc1bb4a4-4969-418f-813e-19de4a9c93e6-kube-api-access-ljh5k\") pod \"console-5fff764dd4-vmhff\" (UID: \"bc1bb4a4-4969-418f-813e-19de4a9c93e6\") " pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.599829 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.599797 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:21.729815 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.729783 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fff764dd4-vmhff"] Jul 21 18:38:21.732990 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:38:21.732962 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc1bb4a4_4969_418f_813e_19de4a9c93e6.slice/crio-9dd1b60b37332331f0b13e871cf10a608854e4a7d31a577f9fb1e0387e551989 WatchSource:0}: Error finding container 9dd1b60b37332331f0b13e871cf10a608854e4a7d31a577f9fb1e0387e551989: Status 404 returned error can't find the container with id 9dd1b60b37332331f0b13e871cf10a608854e4a7d31a577f9fb1e0387e551989 Jul 21 18:38:21.744667 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:21.744642 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fff764dd4-vmhff" event={"ID":"bc1bb4a4-4969-418f-813e-19de4a9c93e6","Type":"ContainerStarted","Data":"9dd1b60b37332331f0b13e871cf10a608854e4a7d31a577f9fb1e0387e551989"} Jul 21 18:38:22.749664 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:22.749625 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fff764dd4-vmhff" event={"ID":"bc1bb4a4-4969-418f-813e-19de4a9c93e6","Type":"ContainerStarted","Data":"9c85de92cae7ce96d07bae1230cebb2aac3f3381f346fa77c793f44f78107766"} Jul 21 18:38:22.768639 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:22.768587 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fff764dd4-vmhff" podStartSLOduration=1.768567429 podStartE2EDuration="1.768567429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:38:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:38:22.768450704 +0000 UTC m=+465.830530325" watchObservedRunningTime="2026-07-21 18:38:22.768567429 +0000 UTC m=+465.830647411" Jul 21 18:38:31.600931 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:31.600887 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:31.601305 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:31.600963 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:31.605649 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:31.605623 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:38:31.786527 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:38:31.786501 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fff764dd4-vmhff" Jul 21 18:42:51.159318 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:42:51.159283 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-dk6pn"] Jul 21 18:42:51.162508 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:42:51.162480 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-dk6pn" Jul 21 18:42:51.165588 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:42:51.165565 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 21 18:42:51.165893 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:42:51.165875 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 21 18:42:51.165958 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:42:51.165928 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-42qmz\"" Jul 21 18:42:51.197674 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:42:51.197646 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-dk6pn"] Jul 21 18:42:51.273341 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:42:51.273304 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rwr6\" (UniqueName: \"kubernetes.io/projected/638a94c9-b9db-4b3c-8250-a88c49abd2c4-kube-api-access-5rwr6\") pod \"redis-69bbd798b6-dk6pn\" (UID: \"638a94c9-b9db-4b3c-8250-a88c49abd2c4\") " pod="test-ns-feast/redis-69bbd798b6-dk6pn" Jul 21 18:42:51.374777 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:42:51.374747 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rwr6\" (UniqueName: \"kubernetes.io/projected/638a94c9-b9db-4b3c-8250-a88c49abd2c4-kube-api-access-5rwr6\") pod \"redis-69bbd798b6-dk6pn\" (UID: \"638a94c9-b9db-4b3c-8250-a88c49abd2c4\") " pod="test-ns-feast/redis-69bbd798b6-dk6pn" Jul 21 18:42:51.385050 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:42:51.385022 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rwr6\" (UniqueName: \"kubernetes.io/projected/638a94c9-b9db-4b3c-8250-a88c49abd2c4-kube-api-access-5rwr6\") pod \"redis-69bbd798b6-dk6pn\" (UID: \"638a94c9-b9db-4b3c-8250-a88c49abd2c4\") " pod="test-ns-feast/redis-69bbd798b6-dk6pn" Jul 21 18:42:51.483129 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:42:51.483037 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-dk6pn" Jul 21 18:42:51.615953 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:42:51.615919 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-dk6pn"] Jul 21 18:42:51.621641 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:42:51.619501 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod638a94c9_b9db_4b3c_8250_a88c49abd2c4.slice/crio-0815c001303950a669a9917664b1b335dcc1a2c516de7fc032b5e8b81e5dbaa6 WatchSource:0}: Error finding container 0815c001303950a669a9917664b1b335dcc1a2c516de7fc032b5e8b81e5dbaa6: Status 404 returned error can't find the container with id 0815c001303950a669a9917664b1b335dcc1a2c516de7fc032b5e8b81e5dbaa6 Jul 21 18:42:51.622733 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:42:51.622712 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 18:42:51.706055 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:42:51.706024 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-dk6pn" event={"ID":"638a94c9-b9db-4b3c-8250-a88c49abd2c4","Type":"ContainerStarted","Data":"0815c001303950a669a9917664b1b335dcc1a2c516de7fc032b5e8b81e5dbaa6"} Jul 21 18:42:53.716139 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:42:53.716094 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-dk6pn" event={"ID":"638a94c9-b9db-4b3c-8250-a88c49abd2c4","Type":"ContainerStarted","Data":"14a54b24bd95040e10a6ced988ea15d10e970524d0bc74d941685e7e9018a6f7"} Jul 21 18:43:24.649955 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:24.649895 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-dk6pn" podStartSLOduration=32.287748706 podStartE2EDuration="33.649876828s" totalImagesPullingTime="1.362128122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:42:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:42:53.748580268 +0000 UTC m=+736.810659877" watchObservedRunningTime="2026-07-21 18:43:24.649876828 +0000 UTC m=+767.711956433" Jul 21 18:43:24.650490 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:24.650474 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-pkdxq"] Jul 21 18:43:24.655225 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:24.655209 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-pkdxq" Jul 21 18:43:24.657638 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:24.657614 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Jul 21 18:43:24.657758 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:24.657697 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-b9gqt\"" Jul 21 18:43:24.662243 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:24.662218 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx94x\" (UniqueName: \"kubernetes.io/projected/72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6-kube-api-access-hx94x\") pod \"feast-test-apply-pkdxq\" (UID: \"72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6\") " pod="test-ns-feast/feast-test-apply-pkdxq" Jul 21 18:43:24.662570 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:24.662522 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-pkdxq"] Jul 21 18:43:24.762797 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:24.762761 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx94x\" (UniqueName: \"kubernetes.io/projected/72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6-kube-api-access-hx94x\") pod \"feast-test-apply-pkdxq\" (UID: \"72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6\") " pod="test-ns-feast/feast-test-apply-pkdxq" Jul 21 18:43:24.773032 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:24.773002 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx94x\" (UniqueName: \"kubernetes.io/projected/72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6-kube-api-access-hx94x\") pod \"feast-test-apply-pkdxq\" (UID: \"72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6\") " pod="test-ns-feast/feast-test-apply-pkdxq" Jul 21 18:43:24.964553 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:24.964462 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-pkdxq" Jul 21 18:43:25.092554 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:25.092524 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-pkdxq"] Jul 21 18:43:25.095812 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:43:25.095784 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72eeb078_9d4e_4b23_ae8c_cd98b4ff9ca6.slice/crio-c96e8b4b7655cffb157e8e02b2a52b44b54bf94741fdbb1bf465b8950fba758d WatchSource:0}: Error finding container c96e8b4b7655cffb157e8e02b2a52b44b54bf94741fdbb1bf465b8950fba758d: Status 404 returned error can't find the container with id c96e8b4b7655cffb157e8e02b2a52b44b54bf94741fdbb1bf465b8950fba758d Jul 21 18:43:25.839057 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:25.839022 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-pkdxq" event={"ID":"72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6","Type":"ContainerStarted","Data":"c96e8b4b7655cffb157e8e02b2a52b44b54bf94741fdbb1bf465b8950fba758d"} Jul 21 18:43:30.862116 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:30.862086 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-pkdxq" event={"ID":"72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6","Type":"ContainerStarted","Data":"c5a8ca511d351f09284599a2a1cff21e3f171c446bc3d8a6a7ad02fb51639478"} Jul 21 18:43:37.892195 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:37.892154 2556 generic.go:356] "Generic (PLEG): container finished" podID="72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6" containerID="c5a8ca511d351f09284599a2a1cff21e3f171c446bc3d8a6a7ad02fb51639478" exitCode=0 Jul 21 18:43:37.892675 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:37.892234 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-pkdxq" event={"ID":"72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6","Type":"ContainerDied","Data":"c5a8ca511d351f09284599a2a1cff21e3f171c446bc3d8a6a7ad02fb51639478"} Jul 21 18:43:38.898365 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:38.898329 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-pkdxq" event={"ID":"72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6","Type":"ContainerStarted","Data":"c852054f30161b8cf2cbf6922a02c0bbc777565360169e44fec1afd08f64c3f3"} Jul 21 18:43:38.913592 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:38.913537 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-pkdxq" podStartSLOduration=2.93583099 podStartE2EDuration="14.913515068s" totalImagesPullingTime="5.387642326s" totalInitContainerRuntime="6.590041752s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:43:38.913371043 +0000 UTC m=+781.975450653" watchObservedRunningTime="2026-07-21 18:43:38.913515068 +0000 UTC m=+781.975594677" Jul 21 18:43:47.934565 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:47.934482 2556 generic.go:356] "Generic (PLEG): container finished" podID="72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6" containerID="c852054f30161b8cf2cbf6922a02c0bbc777565360169e44fec1afd08f64c3f3" exitCode=0 Jul 21 18:43:47.934914 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:47.934557 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-pkdxq" event={"ID":"72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6","Type":"ContainerDied","Data":"c852054f30161b8cf2cbf6922a02c0bbc777565360169e44fec1afd08f64c3f3"} Jul 21 18:43:49.066634 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:49.066610 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-pkdxq" Jul 21 18:43:49.172346 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:49.172303 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx94x\" (UniqueName: \"kubernetes.io/projected/72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6-kube-api-access-hx94x\") pod \"72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6\" (UID: \"72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6\") " Jul 21 18:43:49.174398 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:49.174374 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6-kube-api-access-hx94x" (OuterVolumeSpecName: "kube-api-access-hx94x") pod "72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6" (UID: "72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6"). InnerVolumeSpecName "kube-api-access-hx94x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:43:49.273017 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:49.272941 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx94x\" (UniqueName: \"kubernetes.io/projected/72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6-kube-api-access-hx94x\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:43:49.943575 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:49.943545 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-pkdxq" Jul 21 18:43:49.943745 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:49.943576 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-pkdxq" event={"ID":"72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6","Type":"ContainerDied","Data":"c96e8b4b7655cffb157e8e02b2a52b44b54bf94741fdbb1bf465b8950fba758d"} Jul 21 18:43:49.943745 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:49.943610 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c96e8b4b7655cffb157e8e02b2a52b44b54bf94741fdbb1bf465b8950fba758d" Jul 21 18:43:50.126749 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:50.126710 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-pkdxq_72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6/feast-0/0.log" Jul 21 18:43:50.133357 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:43:50.133334 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-pkdxq_72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6/feast-1/0.log" Jul 21 18:44:28.185866 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:28.185817 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-pkdxq"] Jul 21 18:44:28.194122 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:28.194093 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-pkdxq"] Jul 21 18:44:28.207634 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:28.207598 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-dk6pn"] Jul 21 18:44:28.207809 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:28.207787 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-dk6pn" podUID="638a94c9-b9db-4b3c-8250-a88c49abd2c4" containerName="redis" containerID="cri-o://14a54b24bd95040e10a6ced988ea15d10e970524d0bc74d941685e7e9018a6f7" gracePeriod=30 Jul 21 18:44:28.449088 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:28.449066 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-dk6pn" Jul 21 18:44:28.505714 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:28.505682 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rwr6\" (UniqueName: \"kubernetes.io/projected/638a94c9-b9db-4b3c-8250-a88c49abd2c4-kube-api-access-5rwr6\") pod \"638a94c9-b9db-4b3c-8250-a88c49abd2c4\" (UID: \"638a94c9-b9db-4b3c-8250-a88c49abd2c4\") " Jul 21 18:44:28.508015 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:28.507979 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/638a94c9-b9db-4b3c-8250-a88c49abd2c4-kube-api-access-5rwr6" (OuterVolumeSpecName: "kube-api-access-5rwr6") pod "638a94c9-b9db-4b3c-8250-a88c49abd2c4" (UID: "638a94c9-b9db-4b3c-8250-a88c49abd2c4"). InnerVolumeSpecName "kube-api-access-5rwr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:44:28.607040 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:28.607001 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rwr6\" (UniqueName: \"kubernetes.io/projected/638a94c9-b9db-4b3c-8250-a88c49abd2c4-kube-api-access-5rwr6\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:44:28.980589 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:28.980558 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6" path="/var/lib/kubelet/pods/72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6/volumes" Jul 21 18:44:29.086039 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:29.086006 2556 generic.go:356] "Generic (PLEG): container finished" podID="638a94c9-b9db-4b3c-8250-a88c49abd2c4" containerID="14a54b24bd95040e10a6ced988ea15d10e970524d0bc74d941685e7e9018a6f7" exitCode=0 Jul 21 18:44:29.086039 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:29.086042 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-dk6pn" Jul 21 18:44:29.086232 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:29.086046 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-dk6pn" event={"ID":"638a94c9-b9db-4b3c-8250-a88c49abd2c4","Type":"ContainerDied","Data":"14a54b24bd95040e10a6ced988ea15d10e970524d0bc74d941685e7e9018a6f7"} Jul 21 18:44:29.086232 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:29.086140 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-dk6pn" event={"ID":"638a94c9-b9db-4b3c-8250-a88c49abd2c4","Type":"ContainerDied","Data":"0815c001303950a669a9917664b1b335dcc1a2c516de7fc032b5e8b81e5dbaa6"} Jul 21 18:44:29.086232 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:29.086166 2556 scope.go:117] "RemoveContainer" containerID="14a54b24bd95040e10a6ced988ea15d10e970524d0bc74d941685e7e9018a6f7" Jul 21 18:44:29.093989 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:29.093970 2556 scope.go:117] "RemoveContainer" containerID="14a54b24bd95040e10a6ced988ea15d10e970524d0bc74d941685e7e9018a6f7" Jul 21 18:44:29.094287 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:44:29.094271 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14a54b24bd95040e10a6ced988ea15d10e970524d0bc74d941685e7e9018a6f7\": container with ID starting with 14a54b24bd95040e10a6ced988ea15d10e970524d0bc74d941685e7e9018a6f7 not found: ID does not exist" containerID="14a54b24bd95040e10a6ced988ea15d10e970524d0bc74d941685e7e9018a6f7" Jul 21 18:44:29.094334 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:29.094305 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a54b24bd95040e10a6ced988ea15d10e970524d0bc74d941685e7e9018a6f7"} err="failed to get container status \"14a54b24bd95040e10a6ced988ea15d10e970524d0bc74d941685e7e9018a6f7\": rpc error: code = NotFound desc = could not find container \"14a54b24bd95040e10a6ced988ea15d10e970524d0bc74d941685e7e9018a6f7\": container with ID starting with 14a54b24bd95040e10a6ced988ea15d10e970524d0bc74d941685e7e9018a6f7 not found: ID does not exist" Jul 21 18:44:29.100739 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:29.100716 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-dk6pn"] Jul 21 18:44:29.104543 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:29.104524 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-dk6pn"] Jul 21 18:44:30.980401 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:44:30.980369 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="638a94c9-b9db-4b3c-8250-a88c49abd2c4" path="/var/lib/kubelet/pods/638a94c9-b9db-4b3c-8250-a88c49abd2c4/volumes" Jul 21 18:49:38.183458 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.183418 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc"] Jul 21 18:49:38.183913 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.183700 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="638a94c9-b9db-4b3c-8250-a88c49abd2c4" containerName="redis" Jul 21 18:49:38.183913 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.183711 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="638a94c9-b9db-4b3c-8250-a88c49abd2c4" containerName="redis" Jul 21 18:49:38.183913 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.183727 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6" containerName="feast-0" Jul 21 18:49:38.183913 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.183732 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6" containerName="feast-0" Jul 21 18:49:38.183913 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.183741 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6" containerName="feast-1" Jul 21 18:49:38.183913 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.183747 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6" containerName="feast-1" Jul 21 18:49:38.183913 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.183794 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="638a94c9-b9db-4b3c-8250-a88c49abd2c4" containerName="redis" Jul 21 18:49:38.183913 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.183801 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="72eeb078-9d4e-4b23-ae8c-cd98b4ff9ca6" containerName="feast-1" Jul 21 18:49:38.186552 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.186537 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc" Jul 21 18:49:38.193450 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.193427 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jul 21 18:49:38.194398 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.194378 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jul 21 18:49:38.194511 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.194383 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-cnntn\"" Jul 21 18:49:38.209195 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.209164 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc"] Jul 21 18:49:38.348139 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.348101 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk7wk\" (UniqueName: \"kubernetes.io/projected/4919b4ec-e461-404f-8c20-953a10b3141f-kube-api-access-vk7wk\") pod \"feast-operator-controller-manager-7495bcd-5kprc\" (UID: \"4919b4ec-e461-404f-8c20-953a10b3141f\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc" Jul 21 18:49:38.448838 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.448764 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk7wk\" (UniqueName: \"kubernetes.io/projected/4919b4ec-e461-404f-8c20-953a10b3141f-kube-api-access-vk7wk\") pod \"feast-operator-controller-manager-7495bcd-5kprc\" (UID: \"4919b4ec-e461-404f-8c20-953a10b3141f\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc" Jul 21 18:49:38.459245 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.459215 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk7wk\" (UniqueName: \"kubernetes.io/projected/4919b4ec-e461-404f-8c20-953a10b3141f-kube-api-access-vk7wk\") pod \"feast-operator-controller-manager-7495bcd-5kprc\" (UID: \"4919b4ec-e461-404f-8c20-953a10b3141f\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc" Jul 21 18:49:38.495974 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.495942 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc" Jul 21 18:49:38.627236 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.627142 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc"] Jul 21 18:49:38.629925 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:49:38.629883 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4919b4ec_e461_404f_8c20_953a10b3141f.slice/crio-faed93951c4196c5bd8e8ba3314e9800c52791d2f99697dd30f68c2c3aaa3ba7 WatchSource:0}: Error finding container faed93951c4196c5bd8e8ba3314e9800c52791d2f99697dd30f68c2c3aaa3ba7: Status 404 returned error can't find the container with id faed93951c4196c5bd8e8ba3314e9800c52791d2f99697dd30f68c2c3aaa3ba7 Jul 21 18:49:38.631802 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.631786 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 18:49:38.935658 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.935628 2556 scope.go:117] "RemoveContainer" containerID="c852054f30161b8cf2cbf6922a02c0bbc777565360169e44fec1afd08f64c3f3" Jul 21 18:49:38.943250 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:38.943231 2556 scope.go:117] "RemoveContainer" containerID="c5a8ca511d351f09284599a2a1cff21e3f171c446bc3d8a6a7ad02fb51639478" Jul 21 18:49:39.264453 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:39.264366 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc" event={"ID":"4919b4ec-e461-404f-8c20-953a10b3141f","Type":"ContainerStarted","Data":"faed93951c4196c5bd8e8ba3314e9800c52791d2f99697dd30f68c2c3aaa3ba7"} Jul 21 18:49:41.274694 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:41.274658 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc" event={"ID":"4919b4ec-e461-404f-8c20-953a10b3141f","Type":"ContainerStarted","Data":"b0b2e95dc0dcf82ccfd9dd954ffab96218486180d835cd4ce343dc12c9d34896"} Jul 21 18:49:41.275135 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:41.274791 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc" Jul 21 18:49:41.298386 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:41.298328 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc" podStartSLOduration=0.85118693 podStartE2EDuration="3.298304825s" totalImagesPullingTime="2.447117895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:49:41.296428398 +0000 UTC m=+1144.358508007" watchObservedRunningTime="2026-07-21 18:49:41.298304825 +0000 UTC m=+1144.360384442" Jul 21 18:49:52.282043 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:52.282012 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc" Jul 21 18:49:54.981127 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:54.981089 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx"] Jul 21 18:49:54.986199 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:54.986176 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:54.988884 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:54.988854 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jul 21 18:49:54.989007 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:54.988908 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 21 18:49:54.989101 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:54.989082 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-94tdc\"" Jul 21 18:49:54.989150 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:54.989122 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jul 21 18:49:54.989306 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:54.989292 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jul 21 18:49:54.990079 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:54.990064 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 21 18:49:54.990166 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:54.990154 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jul 21 18:49:54.996812 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:54.996791 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx"] Jul 21 18:49:55.082838 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.082808 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.083028 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.082864 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtx8p\" (UniqueName: \"kubernetes.io/projected/430a2554-f0b1-4784-ba42-ba40b8ba63f1-kube-api-access-qtx8p\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.083028 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.082911 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.083028 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.082935 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/430a2554-f0b1-4784-ba42-ba40b8ba63f1-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.083124 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.083046 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.083124 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.083100 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.184290 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.184252 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.184290 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.184290 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/430a2554-f0b1-4784-ba42-ba40b8ba63f1-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.184537 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.184349 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.184537 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.184386 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.184537 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.184411 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.184537 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.184435 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtx8p\" (UniqueName: \"kubernetes.io/projected/430a2554-f0b1-4784-ba42-ba40b8ba63f1-kube-api-access-qtx8p\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.184731 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:49:55.184601 2556 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Jul 21 18:49:55.184731 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:49:55.184707 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-registry-tls podName:430a2554-f0b1-4784-ba42-ba40b8ba63f1 nodeName:}" failed. No retries permitted until 2026-07-21 18:49:55.684686994 +0000 UTC m=+1158.746766586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-registry-tls") pod "feast-simple-feast-setup-777d6cc998-27bkx" (UID: "430a2554-f0b1-4784-ba42-ba40b8ba63f1") : secret "feast-simple-feast-setup-registry-tls" not found Jul 21 18:49:55.184873 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.184771 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/430a2554-f0b1-4784-ba42-ba40b8ba63f1-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.186959 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.186933 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.186959 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.186949 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.187110 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.186953 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.198656 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.198629 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtx8p\" (UniqueName: \"kubernetes.io/projected/430a2554-f0b1-4784-ba42-ba40b8ba63f1-kube-api-access-qtx8p\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.687645 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.687607 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.690009 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.689981 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-27bkx\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:55.909478 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:55.909445 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:49:56.042896 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:56.042871 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx"] Jul 21 18:49:56.045102 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:49:56.045073 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod430a2554_f0b1_4784_ba42_ba40b8ba63f1.slice/crio-d765f05d1b13a45372a8c75e605d280e6370743593128a9c577305ccdb452b5b WatchSource:0}: Error finding container d765f05d1b13a45372a8c75e605d280e6370743593128a9c577305ccdb452b5b: Status 404 returned error can't find the container with id d765f05d1b13a45372a8c75e605d280e6370743593128a9c577305ccdb452b5b Jul 21 18:49:56.333452 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:49:56.333422 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" event={"ID":"430a2554-f0b1-4784-ba42-ba40b8ba63f1","Type":"ContainerStarted","Data":"d765f05d1b13a45372a8c75e605d280e6370743593128a9c577305ccdb452b5b"} Jul 21 18:50:13.412978 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:13.412940 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" event={"ID":"430a2554-f0b1-4784-ba42-ba40b8ba63f1","Type":"ContainerStarted","Data":"e99b8b056a1beb2be7f905bb653c20c16bc39395bf01c9b50bbf4c6a231d27ac"} Jul 21 18:50:17.429387 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:17.429355 2556 generic.go:356] "Generic (PLEG): container finished" podID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerID="e99b8b056a1beb2be7f905bb653c20c16bc39395bf01c9b50bbf4c6a231d27ac" exitCode=0 Jul 21 18:50:17.429793 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:17.429431 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" event={"ID":"430a2554-f0b1-4784-ba42-ba40b8ba63f1","Type":"ContainerDied","Data":"e99b8b056a1beb2be7f905bb653c20c16bc39395bf01c9b50bbf4c6a231d27ac"} Jul 21 18:50:18.435667 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:18.435628 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" event={"ID":"430a2554-f0b1-4784-ba42-ba40b8ba63f1","Type":"ContainerStarted","Data":"2fdd7e63bff42b8641f31106376ec65e8929f198875bac689a8f3c3a65ff4ce3"} Jul 21 18:50:23.459883 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:23.459831 2556 generic.go:356] "Generic (PLEG): container finished" podID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerID="2fdd7e63bff42b8641f31106376ec65e8929f198875bac689a8f3c3a65ff4ce3" exitCode=0 Jul 21 18:50:23.460238 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:23.459908 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" event={"ID":"430a2554-f0b1-4784-ba42-ba40b8ba63f1","Type":"ContainerDied","Data":"2fdd7e63bff42b8641f31106376ec65e8929f198875bac689a8f3c3a65ff4ce3"} Jul 21 18:50:24.470627 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:24.470584 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" event={"ID":"430a2554-f0b1-4784-ba42-ba40b8ba63f1","Type":"ContainerStarted","Data":"f58bf45c2e386b5148f338735c93c2408a68d7a6c4b8169a44aaa9a65eadfcc5"} Jul 21 18:50:24.471245 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:24.470649 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" event={"ID":"430a2554-f0b1-4784-ba42-ba40b8ba63f1","Type":"ContainerStarted","Data":"778c2b6b5d911b9d2eca1d7018c74a96b578d4e97eeafa625d8dedeca828ce5f"} Jul 21 18:50:24.471245 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:24.470671 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" event={"ID":"430a2554-f0b1-4784-ba42-ba40b8ba63f1","Type":"ContainerStarted","Data":"21e2933afa5c97e434119453f76da350da5921335eeef36300e2889c5ec9a2ad"} Jul 21 18:50:24.471245 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:24.470690 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" event={"ID":"430a2554-f0b1-4784-ba42-ba40b8ba63f1","Type":"ContainerStarted","Data":"3ac0af2367f87ba7b92a0aad0ab47b8b8c1a7a9405e7c4adbff2e83e8bf42c3d"} Jul 21 18:50:24.498789 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:24.498714 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podStartSLOduration=14.181961239 podStartE2EDuration="30.498690698s" totalImagesPullingTime="16.316729459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:50:24.496136478 +0000 UTC m=+1187.558216087" watchObservedRunningTime="2026-07-21 18:50:24.498690698 +0000 UTC m=+1187.560770309" Jul 21 18:50:25.909832 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:25.909794 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:50:25.910394 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:25.910376 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:50:25.910520 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:25.910501 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:50:25.910663 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:25.910528 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:50:25.910663 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:25.910546 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:50:25.910663 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:25.910563 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:50:25.910663 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:25.910581 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:50:25.910663 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:25.910597 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:50:25.911676 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:25.911647 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Jul 21 18:50:25.911928 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:25.911681 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.21:6571: connect: connection refused" Jul 21 18:50:25.912020 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:25.911720 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.21:8816: connect: connection refused" Jul 21 18:50:25.912091 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:25.912051 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Jul 21 18:50:28.909868 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:28.909793 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.21:8816: connect: connection refused" Jul 21 18:50:28.909868 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:28.909794 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.21:6571: connect: connection refused" Jul 21 18:50:28.910431 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:28.909811 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Jul 21 18:50:28.910431 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:28.909985 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Jul 21 18:50:31.911180 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:31.911124 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:50:31.911571 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:31.911396 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:50:31.911571 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:31.911521 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:50:31.912161 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:31.912135 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:50:31.912287 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:31.912191 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:50:31.912468 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:31.912450 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:50:31.916365 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:31.916339 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:50:32.516824 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:50:32.516793 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:51:34.257363 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.257281 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx"] Jul 21 18:51:34.257973 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.257521 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="registry" containerID="cri-o://3ac0af2367f87ba7b92a0aad0ab47b8b8c1a7a9405e7c4adbff2e83e8bf42c3d" gracePeriod=30 Jul 21 18:51:34.257973 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.257558 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="ui" containerID="cri-o://f58bf45c2e386b5148f338735c93c2408a68d7a6c4b8169a44aaa9a65eadfcc5" gracePeriod=30 Jul 21 18:51:34.257973 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.257618 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="offline" containerID="cri-o://778c2b6b5d911b9d2eca1d7018c74a96b578d4e97eeafa625d8dedeca828ce5f" gracePeriod=30 Jul 21 18:51:34.257973 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.257637 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="online" containerID="cri-o://21e2933afa5c97e434119453f76da350da5921335eeef36300e2889c5ec9a2ad" gracePeriod=30 Jul 21 18:51:34.554395 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.554306 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv"] Jul 21 18:51:34.557111 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.557088 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.559459 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.559440 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-pzs87\"" Jul 21 18:51:34.570255 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.570232 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv"] Jul 21 18:51:34.633216 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.633174 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.633404 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.633237 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtbfh\" (UniqueName: \"kubernetes.io/projected/61946f32-c093-406a-b50b-f51d784d0dc8-kube-api-access-gtbfh\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.633404 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.633264 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/61946f32-c093-406a-b50b-f51d784d0dc8-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.633404 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.633307 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.633404 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.633361 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.633404 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.633382 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.734360 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.734315 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtbfh\" (UniqueName: \"kubernetes.io/projected/61946f32-c093-406a-b50b-f51d784d0dc8-kube-api-access-gtbfh\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.734574 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.734391 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/61946f32-c093-406a-b50b-f51d784d0dc8-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.734574 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.734431 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.734574 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.734455 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.734574 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.734486 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.734574 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.734550 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.734890 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.734868 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/61946f32-c093-406a-b50b-f51d784d0dc8-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.737284 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.737236 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.737442 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.737321 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.737568 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.737542 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.737637 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.737597 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.742937 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.742906 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtbfh\" (UniqueName: \"kubernetes.io/projected/61946f32-c093-406a-b50b-f51d784d0dc8-kube-api-access-gtbfh\") pod \"feast-simple-feast-setup-777d6cc998-dz5nv\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:34.866736 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:34.866700 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:35.003337 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:35.003309 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv"] Jul 21 18:51:35.005166 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:51:35.005129 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61946f32_c093_406a_b50b_f51d784d0dc8.slice/crio-4453170c3ec2fd5ee1d663ee34627c9669e77f9de887c2f4f9a671f64a3cfa4f WatchSource:0}: Error finding container 4453170c3ec2fd5ee1d663ee34627c9669e77f9de887c2f4f9a671f64a3cfa4f: Status 404 returned error can't find the container with id 4453170c3ec2fd5ee1d663ee34627c9669e77f9de887c2f4f9a671f64a3cfa4f Jul 21 18:51:35.759178 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:35.759139 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" event={"ID":"61946f32-c093-406a-b50b-f51d784d0dc8","Type":"ContainerStarted","Data":"83eb0c8a8e3e3071ff968da16b72867c6d0581f2c2dd245b5c557cc8c2208692"} Jul 21 18:51:35.759565 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:35.759196 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" event={"ID":"61946f32-c093-406a-b50b-f51d784d0dc8","Type":"ContainerStarted","Data":"4453170c3ec2fd5ee1d663ee34627c9669e77f9de887c2f4f9a671f64a3cfa4f"} Jul 21 18:51:35.762347 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:35.762320 2556 generic.go:356] "Generic (PLEG): container finished" podID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerID="f58bf45c2e386b5148f338735c93c2408a68d7a6c4b8169a44aaa9a65eadfcc5" exitCode=0 Jul 21 18:51:35.762347 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:35.762344 2556 generic.go:356] "Generic (PLEG): container finished" podID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerID="21e2933afa5c97e434119453f76da350da5921335eeef36300e2889c5ec9a2ad" exitCode=0 Jul 21 18:51:35.762492 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:35.762392 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" event={"ID":"430a2554-f0b1-4784-ba42-ba40b8ba63f1","Type":"ContainerDied","Data":"f58bf45c2e386b5148f338735c93c2408a68d7a6c4b8169a44aaa9a65eadfcc5"} Jul 21 18:51:35.762492 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:35.762429 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" event={"ID":"430a2554-f0b1-4784-ba42-ba40b8ba63f1","Type":"ContainerDied","Data":"21e2933afa5c97e434119453f76da350da5921335eeef36300e2889c5ec9a2ad"} Jul 21 18:51:40.783634 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:40.783598 2556 generic.go:356] "Generic (PLEG): container finished" podID="61946f32-c093-406a-b50b-f51d784d0dc8" containerID="83eb0c8a8e3e3071ff968da16b72867c6d0581f2c2dd245b5c557cc8c2208692" exitCode=0 Jul 21 18:51:40.784078 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:40.783670 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" event={"ID":"61946f32-c093-406a-b50b-f51d784d0dc8","Type":"ContainerDied","Data":"83eb0c8a8e3e3071ff968da16b72867c6d0581f2c2dd245b5c557cc8c2208692"} Jul 21 18:51:41.790357 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:41.790325 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" event={"ID":"61946f32-c093-406a-b50b-f51d784d0dc8","Type":"ContainerStarted","Data":"7b57c9a7042341d1944fe4f1c94e30e865b00832175cea1e2f93ce0e75d2d924"} Jul 21 18:51:41.912474 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:41.912425 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Jul 21 18:51:42.514061 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:42.514020 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Jul 21 18:51:46.815333 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:46.815243 2556 generic.go:356] "Generic (PLEG): container finished" podID="61946f32-c093-406a-b50b-f51d784d0dc8" containerID="7b57c9a7042341d1944fe4f1c94e30e865b00832175cea1e2f93ce0e75d2d924" exitCode=0 Jul 21 18:51:46.815333 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:46.815291 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" event={"ID":"61946f32-c093-406a-b50b-f51d784d0dc8","Type":"ContainerDied","Data":"7b57c9a7042341d1944fe4f1c94e30e865b00832175cea1e2f93ce0e75d2d924"} Jul 21 18:51:47.826117 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:47.826069 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" event={"ID":"61946f32-c093-406a-b50b-f51d784d0dc8","Type":"ContainerStarted","Data":"696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d"} Jul 21 18:51:47.826604 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:47.826136 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" event={"ID":"61946f32-c093-406a-b50b-f51d784d0dc8","Type":"ContainerStarted","Data":"83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a"} Jul 21 18:51:47.826604 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:47.826158 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" event={"ID":"61946f32-c093-406a-b50b-f51d784d0dc8","Type":"ContainerStarted","Data":"d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847"} Jul 21 18:51:47.826604 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:47.826176 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" event={"ID":"61946f32-c093-406a-b50b-f51d784d0dc8","Type":"ContainerStarted","Data":"1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa"} Jul 21 18:51:47.853135 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:47.853060 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" podStartSLOduration=13.853037887 podStartE2EDuration="13.853037887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:51:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:51:47.850355105 +0000 UTC m=+1270.912434715" watchObservedRunningTime="2026-07-21 18:51:47.853037887 +0000 UTC m=+1270.915117497" Jul 21 18:51:49.867860 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:49.867805 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:49.868323 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:49.867889 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:49.868323 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:49.867910 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:49.868950 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:49.868545 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:49.870014 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:49.869979 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Jul 21 18:51:49.870116 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:49.870016 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused" Jul 21 18:51:49.870176 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:49.870116 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused" Jul 21 18:51:49.870293 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:49.870259 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Jul 21 18:51:51.913278 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:51.912975 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Jul 21 18:51:52.513824 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:52.513779 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Jul 21 18:51:52.867545 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:52.867468 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Jul 21 18:51:52.868147 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:52.868117 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:52.868636 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:52.868613 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:52.868762 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:52.868655 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:52.868984 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:52.868963 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:52.873435 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:52.873417 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:53.856936 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:53.856892 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:53.856936 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:53.856943 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:53.857508 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:53.857490 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:53.860130 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:53.860115 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:54.867154 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:54.867118 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:55.868643 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:55.868608 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:51:56.868988 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:51:56.868956 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:52:01.912112 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:01.912066 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Jul 21 18:52:01.912578 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:01.912238 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:52:02.513806 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:02.513761 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Jul 21 18:52:02.514045 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:02.513921 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:52:04.902680 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:04.902649 2556 generic.go:356] "Generic (PLEG): container finished" podID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerID="778c2b6b5d911b9d2eca1d7018c74a96b578d4e97eeafa625d8dedeca828ce5f" exitCode=137 Jul 21 18:52:04.902680 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:04.902674 2556 generic.go:356] "Generic (PLEG): container finished" podID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerID="3ac0af2367f87ba7b92a0aad0ab47b8b8c1a7a9405e7c4adbff2e83e8bf42c3d" exitCode=137 Jul 21 18:52:04.903092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:04.902695 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" event={"ID":"430a2554-f0b1-4784-ba42-ba40b8ba63f1","Type":"ContainerDied","Data":"778c2b6b5d911b9d2eca1d7018c74a96b578d4e97eeafa625d8dedeca828ce5f"} Jul 21 18:52:04.903092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:04.902762 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" event={"ID":"430a2554-f0b1-4784-ba42-ba40b8ba63f1","Type":"ContainerDied","Data":"3ac0af2367f87ba7b92a0aad0ab47b8b8c1a7a9405e7c4adbff2e83e8bf42c3d"} Jul 21 18:52:04.903092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:04.902786 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" event={"ID":"430a2554-f0b1-4784-ba42-ba40b8ba63f1","Type":"ContainerDied","Data":"d765f05d1b13a45372a8c75e605d280e6370743593128a9c577305ccdb452b5b"} Jul 21 18:52:04.903092 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:04.902808 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d765f05d1b13a45372a8c75e605d280e6370743593128a9c577305ccdb452b5b" Jul 21 18:52:04.903908 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:04.903891 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:52:05.021546 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.021513 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-registry-tls\") pod \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " Jul 21 18:52:05.021718 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.021556 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-offline-tls\") pod \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " Jul 21 18:52:05.021718 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.021583 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtx8p\" (UniqueName: \"kubernetes.io/projected/430a2554-f0b1-4784-ba42-ba40b8ba63f1-kube-api-access-qtx8p\") pod \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " Jul 21 18:52:05.021718 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.021633 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-online-tls\") pod \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " Jul 21 18:52:05.021718 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.021700 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/430a2554-f0b1-4784-ba42-ba40b8ba63f1-feast-data\") pod \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " Jul 21 18:52:05.022003 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.021726 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-ui-tls\") pod \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\" (UID: \"430a2554-f0b1-4784-ba42-ba40b8ba63f1\") " Jul 21 18:52:05.022335 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.022279 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/430a2554-f0b1-4784-ba42-ba40b8ba63f1-feast-data" (OuterVolumeSpecName: "feast-data") pod "430a2554-f0b1-4784-ba42-ba40b8ba63f1" (UID: "430a2554-f0b1-4784-ba42-ba40b8ba63f1"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:52:05.023831 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.023807 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "430a2554-f0b1-4784-ba42-ba40b8ba63f1" (UID: "430a2554-f0b1-4784-ba42-ba40b8ba63f1"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:52:05.023939 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.023830 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-online-tls" (OuterVolumeSpecName: "online-tls") pod "430a2554-f0b1-4784-ba42-ba40b8ba63f1" (UID: "430a2554-f0b1-4784-ba42-ba40b8ba63f1"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:52:05.023939 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.023869 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "430a2554-f0b1-4784-ba42-ba40b8ba63f1" (UID: "430a2554-f0b1-4784-ba42-ba40b8ba63f1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:52:05.024114 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.024093 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/430a2554-f0b1-4784-ba42-ba40b8ba63f1-kube-api-access-qtx8p" (OuterVolumeSpecName: "kube-api-access-qtx8p") pod "430a2554-f0b1-4784-ba42-ba40b8ba63f1" (UID: "430a2554-f0b1-4784-ba42-ba40b8ba63f1"). InnerVolumeSpecName "kube-api-access-qtx8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:52:05.024176 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.024113 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "430a2554-f0b1-4784-ba42-ba40b8ba63f1" (UID: "430a2554-f0b1-4784-ba42-ba40b8ba63f1"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:52:05.122394 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.122357 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-registry-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:52:05.122394 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.122383 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-offline-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:52:05.122394 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.122393 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtx8p\" (UniqueName: \"kubernetes.io/projected/430a2554-f0b1-4784-ba42-ba40b8ba63f1-kube-api-access-qtx8p\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:52:05.122394 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.122403 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-online-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:52:05.122751 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.122411 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/430a2554-f0b1-4784-ba42-ba40b8ba63f1-feast-data\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:52:05.122751 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.122419 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/430a2554-f0b1-4784-ba42-ba40b8ba63f1-ui-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:52:05.906638 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.906607 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx" Jul 21 18:52:05.928213 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.928180 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx"] Jul 21 18:52:05.932097 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:05.932070 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-27bkx"] Jul 21 18:52:06.984130 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:06.981916 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" path="/var/lib/kubelet/pods/430a2554-f0b1-4784-ba42-ba40b8ba63f1/volumes" Jul 21 18:52:58.364381 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.364346 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk"] Jul 21 18:52:58.364828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.364632 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="online" Jul 21 18:52:58.364828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.364642 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="online" Jul 21 18:52:58.364828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.364653 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="offline" Jul 21 18:52:58.364828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.364659 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="offline" Jul 21 18:52:58.364828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.364669 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="registry" Jul 21 18:52:58.364828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.364676 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="registry" Jul 21 18:52:58.364828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.364692 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="ui" Jul 21 18:52:58.364828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.364698 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="ui" Jul 21 18:52:58.364828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.364707 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="feast-init" Jul 21 18:52:58.364828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.364712 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="feast-init" Jul 21 18:52:58.364828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.364719 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="feast-apply" Jul 21 18:52:58.364828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.364724 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="feast-apply" Jul 21 18:52:58.364828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.364767 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="ui" Jul 21 18:52:58.364828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.364774 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="online" Jul 21 18:52:58.364828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.364782 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="registry" Jul 21 18:52:58.364828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.364789 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="430a2554-f0b1-4784-ba42-ba40b8ba63f1" containerName="offline" Jul 21 18:52:58.367005 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.366989 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:58.369455 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.369430 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jul 21 18:52:58.369625 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.369483 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jul 21 18:52:58.369625 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.369501 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-mhstp\"" Jul 21 18:52:58.369625 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.369537 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jul 21 18:52:58.370252 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.370237 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jul 21 18:52:58.370366 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.370241 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jul 21 18:52:58.370366 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.370242 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jul 21 18:52:58.379915 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.379896 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk"] Jul 21 18:52:58.466079 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.466048 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:58.466278 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.466109 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:58.466278 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.466192 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/bddd9aa9-2aa0-4036-839e-90fe9a133a17-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:58.466278 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.466246 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:58.466421 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.466309 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bddd9aa9-2aa0-4036-839e-90fe9a133a17-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:58.466421 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.466326 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n49jv\" (UniqueName: \"kubernetes.io/projected/bddd9aa9-2aa0-4036-839e-90fe9a133a17-kube-api-access-n49jv\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:58.567626 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.567595 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bddd9aa9-2aa0-4036-839e-90fe9a133a17-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:58.567626 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.567628 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n49jv\" (UniqueName: \"kubernetes.io/projected/bddd9aa9-2aa0-4036-839e-90fe9a133a17-kube-api-access-n49jv\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:58.567883 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.567650 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:58.567883 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.567698 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:58.567883 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.567727 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/bddd9aa9-2aa0-4036-839e-90fe9a133a17-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:58.567883 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.567764 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:58.567883 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:52:58.567835 2556 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found Jul 21 18:52:58.568191 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:52:58.567957 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-offline-tls podName:bddd9aa9-2aa0-4036-839e-90fe9a133a17 nodeName:}" failed. No retries permitted until 2026-07-21 18:52:59.067927522 +0000 UTC m=+1342.130007108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-offline-tls") pod "feast-simple-feast-remote-setup-db6955c6c-jlbsk" (UID: "bddd9aa9-2aa0-4036-839e-90fe9a133a17") : secret "feast-simple-feast-remote-setup-offline-tls" not found Jul 21 18:52:58.568191 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.568078 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bddd9aa9-2aa0-4036-839e-90fe9a133a17-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:58.568469 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.568448 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/bddd9aa9-2aa0-4036-839e-90fe9a133a17-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:58.570153 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.570133 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:58.570256 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.570182 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:58.577826 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:58.577804 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n49jv\" (UniqueName: \"kubernetes.io/projected/bddd9aa9-2aa0-4036-839e-90fe9a133a17-kube-api-access-n49jv\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:59.072900 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:59.072861 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:59.075344 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:59.075311 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jlbsk\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:59.276133 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:59.276047 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:52:59.405507 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:52:59.405483 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk"] Jul 21 18:52:59.406710 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:52:59.406686 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbddd9aa9_2aa0_4036_839e_90fe9a133a17.slice/crio-c52d7c032f61c924b17d8e39cab3cc7efa256092f9a0c6c62f9f6c1d50b687ce WatchSource:0}: Error finding container c52d7c032f61c924b17d8e39cab3cc7efa256092f9a0c6c62f9f6c1d50b687ce: Status 404 returned error can't find the container with id c52d7c032f61c924b17d8e39cab3cc7efa256092f9a0c6c62f9f6c1d50b687ce Jul 21 18:53:00.118078 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:00.118037 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" event={"ID":"bddd9aa9-2aa0-4036-839e-90fe9a133a17","Type":"ContainerStarted","Data":"1cab8a1891a58e2040872f5609c868f3c6bb1d45c4c2d3f529a98f73054b60fb"} Jul 21 18:53:00.118286 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:00.118092 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" event={"ID":"bddd9aa9-2aa0-4036-839e-90fe9a133a17","Type":"ContainerStarted","Data":"c52d7c032f61c924b17d8e39cab3cc7efa256092f9a0c6c62f9f6c1d50b687ce"} Jul 21 18:53:05.140216 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:05.140180 2556 generic.go:356] "Generic (PLEG): container finished" podID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerID="1cab8a1891a58e2040872f5609c868f3c6bb1d45c4c2d3f529a98f73054b60fb" exitCode=0 Jul 21 18:53:05.140658 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:05.140253 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" event={"ID":"bddd9aa9-2aa0-4036-839e-90fe9a133a17","Type":"ContainerDied","Data":"1cab8a1891a58e2040872f5609c868f3c6bb1d45c4c2d3f529a98f73054b60fb"} Jul 21 18:53:06.145634 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:06.145599 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" event={"ID":"bddd9aa9-2aa0-4036-839e-90fe9a133a17","Type":"ContainerStarted","Data":"a43eea2c53be8687af1c7cc9420d27235b02a167fe11c4e6f009fc27601c0838"} Jul 21 18:53:11.168758 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:11.168725 2556 generic.go:356] "Generic (PLEG): container finished" podID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerID="a43eea2c53be8687af1c7cc9420d27235b02a167fe11c4e6f009fc27601c0838" exitCode=0 Jul 21 18:53:11.169281 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:11.168762 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" event={"ID":"bddd9aa9-2aa0-4036-839e-90fe9a133a17","Type":"ContainerDied","Data":"a43eea2c53be8687af1c7cc9420d27235b02a167fe11c4e6f009fc27601c0838"} Jul 21 18:53:12.177662 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:12.177624 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" event={"ID":"bddd9aa9-2aa0-4036-839e-90fe9a133a17","Type":"ContainerStarted","Data":"3aacc95597dab683ed963d0e86a7b05934df608ec7f5afde31309d9f5c0a00a1"} Jul 21 18:53:12.178177 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:12.177678 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" event={"ID":"bddd9aa9-2aa0-4036-839e-90fe9a133a17","Type":"ContainerStarted","Data":"203df750c1e589f093e23b5b1174670c7e44659deb556bb538244b403705780a"} Jul 21 18:53:12.178177 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:12.177692 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" event={"ID":"bddd9aa9-2aa0-4036-839e-90fe9a133a17","Type":"ContainerStarted","Data":"ee688e6edad755e412fb1161de2ea5c55e90de5a3ea807cd478ef4b32764aac0"} Jul 21 18:53:12.200203 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:12.199943 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" podStartSLOduration=14.19992239 podStartE2EDuration="14.19992239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:53:12.198209631 +0000 UTC m=+1355.260289240" watchObservedRunningTime="2026-07-21 18:53:12.19992239 +0000 UTC m=+1355.262001999" Jul 21 18:53:14.277221 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:14.277187 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:53:14.277734 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:14.277333 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:53:14.277734 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:14.277360 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:53:14.279232 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:14.279193 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.23:8816: connect: connection refused" Jul 21 18:53:14.279388 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:14.279207 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Jul 21 18:53:14.279388 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:14.279208 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Jul 21 18:53:17.276970 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:17.276923 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Jul 21 18:53:17.278001 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:17.277973 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:53:17.278477 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:17.278449 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:53:17.278909 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:17.278892 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:53:17.284528 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:17.284506 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:53:18.210353 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:18.210314 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:53:18.215125 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:18.215077 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:53:19.276229 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:19.276196 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:53:20.277419 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:20.277387 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:53:21.223029 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:53:21.223000 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:54:23.750413 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:23.750378 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk"] Jul 21 18:54:23.751053 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:23.750681 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="online" containerID="cri-o://ee688e6edad755e412fb1161de2ea5c55e90de5a3ea807cd478ef4b32764aac0" gracePeriod=30 Jul 21 18:54:23.751053 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:23.750758 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="ui" containerID="cri-o://3aacc95597dab683ed963d0e86a7b05934df608ec7f5afde31309d9f5c0a00a1" gracePeriod=30 Jul 21 18:54:23.751053 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:23.750840 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="offline" containerID="cri-o://203df750c1e589f093e23b5b1174670c7e44659deb556bb538244b403705780a" gracePeriod=30 Jul 21 18:54:23.942879 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:23.942830 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv"] Jul 21 18:54:23.943151 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:23.943092 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="registry" containerID="cri-o://1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa" gracePeriod=30 Jul 21 18:54:23.943265 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:23.943175 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="ui" containerID="cri-o://696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d" gracePeriod=30 Jul 21 18:54:23.943265 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:23.943193 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="offline" containerID="cri-o://83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a" gracePeriod=30 Jul 21 18:54:23.943388 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:23.943271 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="online" containerID="cri-o://d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847" gracePeriod=30 Jul 21 18:54:24.483134 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:24.483103 2556 generic.go:356] "Generic (PLEG): container finished" podID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerID="3aacc95597dab683ed963d0e86a7b05934df608ec7f5afde31309d9f5c0a00a1" exitCode=0 Jul 21 18:54:24.483134 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:24.483129 2556 generic.go:356] "Generic (PLEG): container finished" podID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerID="ee688e6edad755e412fb1161de2ea5c55e90de5a3ea807cd478ef4b32764aac0" exitCode=0 Jul 21 18:54:24.483333 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:24.483225 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" event={"ID":"bddd9aa9-2aa0-4036-839e-90fe9a133a17","Type":"ContainerDied","Data":"3aacc95597dab683ed963d0e86a7b05934df608ec7f5afde31309d9f5c0a00a1"} Jul 21 18:54:24.483333 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:24.483254 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" event={"ID":"bddd9aa9-2aa0-4036-839e-90fe9a133a17","Type":"ContainerDied","Data":"ee688e6edad755e412fb1161de2ea5c55e90de5a3ea807cd478ef4b32764aac0"} Jul 21 18:54:25.489826 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:25.489793 2556 generic.go:356] "Generic (PLEG): container finished" podID="61946f32-c093-406a-b50b-f51d784d0dc8" containerID="696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d" exitCode=0 Jul 21 18:54:25.489826 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:25.489816 2556 generic.go:356] "Generic (PLEG): container finished" podID="61946f32-c093-406a-b50b-f51d784d0dc8" containerID="d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847" exitCode=0 Jul 21 18:54:25.490269 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:25.489871 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" event={"ID":"61946f32-c093-406a-b50b-f51d784d0dc8","Type":"ContainerDied","Data":"696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d"} Jul 21 18:54:25.490269 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:25.489921 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" event={"ID":"61946f32-c093-406a-b50b-f51d784d0dc8","Type":"ContainerDied","Data":"d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847"} Jul 21 18:54:26.869406 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:26.869350 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Jul 21 18:54:28.210971 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:28.210931 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Jul 21 18:54:31.223820 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:31.223724 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Jul 21 18:54:33.858048 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:33.858005 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Jul 21 18:54:36.869105 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:36.869056 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Jul 21 18:54:38.210647 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:38.210605 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Jul 21 18:54:41.223033 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:41.222991 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Jul 21 18:54:43.858108 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:43.858056 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Jul 21 18:54:46.869086 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:46.869042 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Jul 21 18:54:46.869479 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:46.869162 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:54:48.210650 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:48.210605 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Jul 21 18:54:48.211112 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:48.210746 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:54:51.223392 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:51.223346 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Jul 21 18:54:51.223784 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:51.223461 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:54:53.857506 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:53.857467 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Jul 21 18:54:53.857878 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:53.857617 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:54:53.938281 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:53.938259 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:54:54.069768 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.069684 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n49jv\" (UniqueName: \"kubernetes.io/projected/bddd9aa9-2aa0-4036-839e-90fe9a133a17-kube-api-access-n49jv\") pod \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " Jul 21 18:54:54.069768 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.069725 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/bddd9aa9-2aa0-4036-839e-90fe9a133a17-registry-tls\") pod \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " Jul 21 18:54:54.069768 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.069769 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-online-tls\") pod \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " Jul 21 18:54:54.070062 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.069817 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bddd9aa9-2aa0-4036-839e-90fe9a133a17-feast-data\") pod \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " Jul 21 18:54:54.070062 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.069874 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-ui-tls\") pod \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " Jul 21 18:54:54.070062 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.069917 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-offline-tls\") pod \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\" (UID: \"bddd9aa9-2aa0-4036-839e-90fe9a133a17\") " Jul 21 18:54:54.070288 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.070256 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bddd9aa9-2aa0-4036-839e-90fe9a133a17-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bddd9aa9-2aa0-4036-839e-90fe9a133a17" (UID: "bddd9aa9-2aa0-4036-839e-90fe9a133a17"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:54:54.070546 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.070499 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bddd9aa9-2aa0-4036-839e-90fe9a133a17-feast-data" (OuterVolumeSpecName: "feast-data") pod "bddd9aa9-2aa0-4036-839e-90fe9a133a17" (UID: "bddd9aa9-2aa0-4036-839e-90fe9a133a17"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:54:54.072118 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.072091 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "bddd9aa9-2aa0-4036-839e-90fe9a133a17" (UID: "bddd9aa9-2aa0-4036-839e-90fe9a133a17"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:54:54.072202 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.072182 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "bddd9aa9-2aa0-4036-839e-90fe9a133a17" (UID: "bddd9aa9-2aa0-4036-839e-90fe9a133a17"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:54:54.072262 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.072247 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bddd9aa9-2aa0-4036-839e-90fe9a133a17-kube-api-access-n49jv" (OuterVolumeSpecName: "kube-api-access-n49jv") pod "bddd9aa9-2aa0-4036-839e-90fe9a133a17" (UID: "bddd9aa9-2aa0-4036-839e-90fe9a133a17"). InnerVolumeSpecName "kube-api-access-n49jv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:54:54.072308 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.072263 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-online-tls" (OuterVolumeSpecName: "online-tls") pod "bddd9aa9-2aa0-4036-839e-90fe9a133a17" (UID: "bddd9aa9-2aa0-4036-839e-90fe9a133a17"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:54:54.171443 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.171407 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-offline-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:54:54.171443 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.171435 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n49jv\" (UniqueName: \"kubernetes.io/projected/bddd9aa9-2aa0-4036-839e-90fe9a133a17-kube-api-access-n49jv\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:54:54.171443 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.171444 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/bddd9aa9-2aa0-4036-839e-90fe9a133a17-registry-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:54:54.171664 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.171474 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-online-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:54:54.171664 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.171481 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bddd9aa9-2aa0-4036-839e-90fe9a133a17-feast-data\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:54:54.171664 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.171489 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bddd9aa9-2aa0-4036-839e-90fe9a133a17-ui-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:54:54.589954 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.589931 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:54:54.611178 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.611148 2556 generic.go:356] "Generic (PLEG): container finished" podID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerID="203df750c1e589f093e23b5b1174670c7e44659deb556bb538244b403705780a" exitCode=137 Jul 21 18:54:54.611333 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.611213 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" Jul 21 18:54:54.611333 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.611226 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" event={"ID":"bddd9aa9-2aa0-4036-839e-90fe9a133a17","Type":"ContainerDied","Data":"203df750c1e589f093e23b5b1174670c7e44659deb556bb538244b403705780a"} Jul 21 18:54:54.611333 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.611265 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk" event={"ID":"bddd9aa9-2aa0-4036-839e-90fe9a133a17","Type":"ContainerDied","Data":"c52d7c032f61c924b17d8e39cab3cc7efa256092f9a0c6c62f9f6c1d50b687ce"} Jul 21 18:54:54.611333 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.611284 2556 scope.go:117] "RemoveContainer" containerID="3aacc95597dab683ed963d0e86a7b05934df608ec7f5afde31309d9f5c0a00a1" Jul 21 18:54:54.614407 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.614382 2556 generic.go:356] "Generic (PLEG): container finished" podID="61946f32-c093-406a-b50b-f51d784d0dc8" containerID="83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a" exitCode=137 Jul 21 18:54:54.614407 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.614404 2556 generic.go:356] "Generic (PLEG): container finished" podID="61946f32-c093-406a-b50b-f51d784d0dc8" containerID="1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa" exitCode=137 Jul 21 18:54:54.614594 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.614444 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" Jul 21 18:54:54.614594 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.614444 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" event={"ID":"61946f32-c093-406a-b50b-f51d784d0dc8","Type":"ContainerDied","Data":"83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a"} Jul 21 18:54:54.614594 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.614485 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" event={"ID":"61946f32-c093-406a-b50b-f51d784d0dc8","Type":"ContainerDied","Data":"1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa"} Jul 21 18:54:54.614594 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.614501 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv" event={"ID":"61946f32-c093-406a-b50b-f51d784d0dc8","Type":"ContainerDied","Data":"4453170c3ec2fd5ee1d663ee34627c9669e77f9de887c2f4f9a671f64a3cfa4f"} Jul 21 18:54:54.621225 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.621208 2556 scope.go:117] "RemoveContainer" containerID="203df750c1e589f093e23b5b1174670c7e44659deb556bb538244b403705780a" Jul 21 18:54:54.629351 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.629335 2556 scope.go:117] "RemoveContainer" containerID="ee688e6edad755e412fb1161de2ea5c55e90de5a3ea807cd478ef4b32764aac0" Jul 21 18:54:54.638127 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.638106 2556 scope.go:117] "RemoveContainer" containerID="a43eea2c53be8687af1c7cc9420d27235b02a167fe11c4e6f009fc27601c0838" Jul 21 18:54:54.638406 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.638381 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk"] Jul 21 18:54:54.643508 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.643487 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jlbsk"] Jul 21 18:54:54.646389 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.646373 2556 scope.go:117] "RemoveContainer" containerID="1cab8a1891a58e2040872f5609c868f3c6bb1d45c4c2d3f529a98f73054b60fb" Jul 21 18:54:54.653528 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.653511 2556 scope.go:117] "RemoveContainer" containerID="3aacc95597dab683ed963d0e86a7b05934df608ec7f5afde31309d9f5c0a00a1" Jul 21 18:54:54.653792 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:54:54.653775 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aacc95597dab683ed963d0e86a7b05934df608ec7f5afde31309d9f5c0a00a1\": container with ID starting with 3aacc95597dab683ed963d0e86a7b05934df608ec7f5afde31309d9f5c0a00a1 not found: ID does not exist" containerID="3aacc95597dab683ed963d0e86a7b05934df608ec7f5afde31309d9f5c0a00a1" Jul 21 18:54:54.653838 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.653803 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aacc95597dab683ed963d0e86a7b05934df608ec7f5afde31309d9f5c0a00a1"} err="failed to get container status \"3aacc95597dab683ed963d0e86a7b05934df608ec7f5afde31309d9f5c0a00a1\": rpc error: code = NotFound desc = could not find container \"3aacc95597dab683ed963d0e86a7b05934df608ec7f5afde31309d9f5c0a00a1\": container with ID starting with 3aacc95597dab683ed963d0e86a7b05934df608ec7f5afde31309d9f5c0a00a1 not found: ID does not exist" Jul 21 18:54:54.653838 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.653823 2556 scope.go:117] "RemoveContainer" containerID="203df750c1e589f093e23b5b1174670c7e44659deb556bb538244b403705780a" Jul 21 18:54:54.654092 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:54:54.654072 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203df750c1e589f093e23b5b1174670c7e44659deb556bb538244b403705780a\": container with ID starting with 203df750c1e589f093e23b5b1174670c7e44659deb556bb538244b403705780a not found: ID does not exist" containerID="203df750c1e589f093e23b5b1174670c7e44659deb556bb538244b403705780a" Jul 21 18:54:54.654130 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.654098 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203df750c1e589f093e23b5b1174670c7e44659deb556bb538244b403705780a"} err="failed to get container status \"203df750c1e589f093e23b5b1174670c7e44659deb556bb538244b403705780a\": rpc error: code = NotFound desc = could not find container \"203df750c1e589f093e23b5b1174670c7e44659deb556bb538244b403705780a\": container with ID starting with 203df750c1e589f093e23b5b1174670c7e44659deb556bb538244b403705780a not found: ID does not exist" Jul 21 18:54:54.654130 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.654112 2556 scope.go:117] "RemoveContainer" containerID="ee688e6edad755e412fb1161de2ea5c55e90de5a3ea807cd478ef4b32764aac0" Jul 21 18:54:54.654346 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:54:54.654329 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee688e6edad755e412fb1161de2ea5c55e90de5a3ea807cd478ef4b32764aac0\": container with ID starting with ee688e6edad755e412fb1161de2ea5c55e90de5a3ea807cd478ef4b32764aac0 not found: ID does not exist" containerID="ee688e6edad755e412fb1161de2ea5c55e90de5a3ea807cd478ef4b32764aac0" Jul 21 18:54:54.654398 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.654349 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee688e6edad755e412fb1161de2ea5c55e90de5a3ea807cd478ef4b32764aac0"} err="failed to get container status \"ee688e6edad755e412fb1161de2ea5c55e90de5a3ea807cd478ef4b32764aac0\": rpc error: code = NotFound desc = could not find container \"ee688e6edad755e412fb1161de2ea5c55e90de5a3ea807cd478ef4b32764aac0\": container with ID starting with ee688e6edad755e412fb1161de2ea5c55e90de5a3ea807cd478ef4b32764aac0 not found: ID does not exist" Jul 21 18:54:54.654398 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.654362 2556 scope.go:117] "RemoveContainer" containerID="a43eea2c53be8687af1c7cc9420d27235b02a167fe11c4e6f009fc27601c0838" Jul 21 18:54:54.654560 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:54:54.654546 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a43eea2c53be8687af1c7cc9420d27235b02a167fe11c4e6f009fc27601c0838\": container with ID starting with a43eea2c53be8687af1c7cc9420d27235b02a167fe11c4e6f009fc27601c0838 not found: ID does not exist" containerID="a43eea2c53be8687af1c7cc9420d27235b02a167fe11c4e6f009fc27601c0838" Jul 21 18:54:54.654599 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.654563 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a43eea2c53be8687af1c7cc9420d27235b02a167fe11c4e6f009fc27601c0838"} err="failed to get container status \"a43eea2c53be8687af1c7cc9420d27235b02a167fe11c4e6f009fc27601c0838\": rpc error: code = NotFound desc = could not find container \"a43eea2c53be8687af1c7cc9420d27235b02a167fe11c4e6f009fc27601c0838\": container with ID starting with a43eea2c53be8687af1c7cc9420d27235b02a167fe11c4e6f009fc27601c0838 not found: ID does not exist" Jul 21 18:54:54.654599 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.654576 2556 scope.go:117] "RemoveContainer" containerID="1cab8a1891a58e2040872f5609c868f3c6bb1d45c4c2d3f529a98f73054b60fb" Jul 21 18:54:54.654752 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:54:54.654736 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cab8a1891a58e2040872f5609c868f3c6bb1d45c4c2d3f529a98f73054b60fb\": container with ID starting with 1cab8a1891a58e2040872f5609c868f3c6bb1d45c4c2d3f529a98f73054b60fb not found: ID does not exist" containerID="1cab8a1891a58e2040872f5609c868f3c6bb1d45c4c2d3f529a98f73054b60fb" Jul 21 18:54:54.654790 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.654755 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cab8a1891a58e2040872f5609c868f3c6bb1d45c4c2d3f529a98f73054b60fb"} err="failed to get container status \"1cab8a1891a58e2040872f5609c868f3c6bb1d45c4c2d3f529a98f73054b60fb\": rpc error: code = NotFound desc = could not find container \"1cab8a1891a58e2040872f5609c868f3c6bb1d45c4c2d3f529a98f73054b60fb\": container with ID starting with 1cab8a1891a58e2040872f5609c868f3c6bb1d45c4c2d3f529a98f73054b60fb not found: ID does not exist" Jul 21 18:54:54.654790 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.654768 2556 scope.go:117] "RemoveContainer" containerID="696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d" Jul 21 18:54:54.662118 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.662101 2556 scope.go:117] "RemoveContainer" containerID="83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a" Jul 21 18:54:54.669428 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.669409 2556 scope.go:117] "RemoveContainer" containerID="d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847" Jul 21 18:54:54.675485 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.675465 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtbfh\" (UniqueName: \"kubernetes.io/projected/61946f32-c093-406a-b50b-f51d784d0dc8-kube-api-access-gtbfh\") pod \"61946f32-c093-406a-b50b-f51d784d0dc8\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " Jul 21 18:54:54.675575 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.675515 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-offline-tls\") pod \"61946f32-c093-406a-b50b-f51d784d0dc8\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " Jul 21 18:54:54.675575 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.675556 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/61946f32-c093-406a-b50b-f51d784d0dc8-feast-data\") pod \"61946f32-c093-406a-b50b-f51d784d0dc8\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " Jul 21 18:54:54.675648 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.675626 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-registry-tls\") pod \"61946f32-c093-406a-b50b-f51d784d0dc8\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " Jul 21 18:54:54.675693 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.675653 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-ui-tls\") pod \"61946f32-c093-406a-b50b-f51d784d0dc8\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " Jul 21 18:54:54.675693 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.675679 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-online-tls\") pod \"61946f32-c093-406a-b50b-f51d784d0dc8\" (UID: \"61946f32-c093-406a-b50b-f51d784d0dc8\") " Jul 21 18:54:54.676239 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.676197 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61946f32-c093-406a-b50b-f51d784d0dc8-feast-data" (OuterVolumeSpecName: "feast-data") pod "61946f32-c093-406a-b50b-f51d784d0dc8" (UID: "61946f32-c093-406a-b50b-f51d784d0dc8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:54:54.676668 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.676570 2556 scope.go:117] "RemoveContainer" containerID="1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa" Jul 21 18:54:54.677962 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.677938 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "61946f32-c093-406a-b50b-f51d784d0dc8" (UID: "61946f32-c093-406a-b50b-f51d784d0dc8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:54:54.678053 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.678012 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "61946f32-c093-406a-b50b-f51d784d0dc8" (UID: "61946f32-c093-406a-b50b-f51d784d0dc8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:54:54.678125 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.678105 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "61946f32-c093-406a-b50b-f51d784d0dc8" (UID: "61946f32-c093-406a-b50b-f51d784d0dc8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:54:54.678185 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.678123 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-online-tls" (OuterVolumeSpecName: "online-tls") pod "61946f32-c093-406a-b50b-f51d784d0dc8" (UID: "61946f32-c093-406a-b50b-f51d784d0dc8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:54:54.678185 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.678154 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61946f32-c093-406a-b50b-f51d784d0dc8-kube-api-access-gtbfh" (OuterVolumeSpecName: "kube-api-access-gtbfh") pod "61946f32-c093-406a-b50b-f51d784d0dc8" (UID: "61946f32-c093-406a-b50b-f51d784d0dc8"). InnerVolumeSpecName "kube-api-access-gtbfh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:54:54.684419 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.684401 2556 scope.go:117] "RemoveContainer" containerID="7b57c9a7042341d1944fe4f1c94e30e865b00832175cea1e2f93ce0e75d2d924" Jul 21 18:54:54.691258 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.691238 2556 scope.go:117] "RemoveContainer" containerID="83eb0c8a8e3e3071ff968da16b72867c6d0581f2c2dd245b5c557cc8c2208692" Jul 21 18:54:54.703686 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.703653 2556 scope.go:117] "RemoveContainer" containerID="696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d" Jul 21 18:54:54.704039 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:54:54.704005 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d\": container with ID starting with 696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d not found: ID does not exist" containerID="696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d" Jul 21 18:54:54.704104 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.704062 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d"} err="failed to get container status \"696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d\": rpc error: code = NotFound desc = could not find container \"696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d\": container with ID starting with 696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d not found: ID does not exist" Jul 21 18:54:54.704104 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.704099 2556 scope.go:117] "RemoveContainer" containerID="83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a" Jul 21 18:54:54.704441 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:54:54.704409 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a\": container with ID starting with 83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a not found: ID does not exist" containerID="83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a" Jul 21 18:54:54.704510 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.704466 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a"} err="failed to get container status \"83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a\": rpc error: code = NotFound desc = could not find container \"83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a\": container with ID starting with 83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a not found: ID does not exist" Jul 21 18:54:54.704561 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.704514 2556 scope.go:117] "RemoveContainer" containerID="d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847" Jul 21 18:54:54.704869 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:54:54.704827 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847\": container with ID starting with d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847 not found: ID does not exist" containerID="d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847" Jul 21 18:54:54.704955 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.704869 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847"} err="failed to get container status \"d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847\": rpc error: code = NotFound desc = could not find container \"d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847\": container with ID starting with d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847 not found: ID does not exist" Jul 21 18:54:54.704955 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.704890 2556 scope.go:117] "RemoveContainer" containerID="1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa" Jul 21 18:54:54.705166 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:54:54.705150 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa\": container with ID starting with 1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa not found: ID does not exist" containerID="1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa" Jul 21 18:54:54.705211 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.705170 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa"} err="failed to get container status \"1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa\": rpc error: code = NotFound desc = could not find container \"1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa\": container with ID starting with 1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa not found: ID does not exist" Jul 21 18:54:54.705211 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.705183 2556 scope.go:117] "RemoveContainer" containerID="7b57c9a7042341d1944fe4f1c94e30e865b00832175cea1e2f93ce0e75d2d924" Jul 21 18:54:54.705432 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:54:54.705416 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b57c9a7042341d1944fe4f1c94e30e865b00832175cea1e2f93ce0e75d2d924\": container with ID starting with 7b57c9a7042341d1944fe4f1c94e30e865b00832175cea1e2f93ce0e75d2d924 not found: ID does not exist" containerID="7b57c9a7042341d1944fe4f1c94e30e865b00832175cea1e2f93ce0e75d2d924" Jul 21 18:54:54.705475 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.705437 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b57c9a7042341d1944fe4f1c94e30e865b00832175cea1e2f93ce0e75d2d924"} err="failed to get container status \"7b57c9a7042341d1944fe4f1c94e30e865b00832175cea1e2f93ce0e75d2d924\": rpc error: code = NotFound desc = could not find container \"7b57c9a7042341d1944fe4f1c94e30e865b00832175cea1e2f93ce0e75d2d924\": container with ID starting with 7b57c9a7042341d1944fe4f1c94e30e865b00832175cea1e2f93ce0e75d2d924 not found: ID does not exist" Jul 21 18:54:54.705475 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.705451 2556 scope.go:117] "RemoveContainer" containerID="83eb0c8a8e3e3071ff968da16b72867c6d0581f2c2dd245b5c557cc8c2208692" Jul 21 18:54:54.705682 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:54:54.705664 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83eb0c8a8e3e3071ff968da16b72867c6d0581f2c2dd245b5c557cc8c2208692\": container with ID starting with 83eb0c8a8e3e3071ff968da16b72867c6d0581f2c2dd245b5c557cc8c2208692 not found: ID does not exist" containerID="83eb0c8a8e3e3071ff968da16b72867c6d0581f2c2dd245b5c557cc8c2208692" Jul 21 18:54:54.705748 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.705689 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83eb0c8a8e3e3071ff968da16b72867c6d0581f2c2dd245b5c557cc8c2208692"} err="failed to get container status \"83eb0c8a8e3e3071ff968da16b72867c6d0581f2c2dd245b5c557cc8c2208692\": rpc error: code = NotFound desc = could not find container \"83eb0c8a8e3e3071ff968da16b72867c6d0581f2c2dd245b5c557cc8c2208692\": container with ID starting with 83eb0c8a8e3e3071ff968da16b72867c6d0581f2c2dd245b5c557cc8c2208692 not found: ID does not exist" Jul 21 18:54:54.705748 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.705708 2556 scope.go:117] "RemoveContainer" containerID="696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d" Jul 21 18:54:54.705985 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.705967 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d"} err="failed to get container status \"696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d\": rpc error: code = NotFound desc = could not find container \"696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d\": container with ID starting with 696e70334c7efb9f7a32e233ae7a83d23ddb615c3890d9c7dd6ba048a1d4d19d not found: ID does not exist" Jul 21 18:54:54.706042 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.705986 2556 scope.go:117] "RemoveContainer" containerID="83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a" Jul 21 18:54:54.706215 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.706197 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a"} err="failed to get container status \"83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a\": rpc error: code = NotFound desc = could not find container \"83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a\": container with ID starting with 83784b7d19f343a1462c730fc52bc5890111183f2313106b6172af1c7e30e47a not found: ID does not exist" Jul 21 18:54:54.706258 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.706217 2556 scope.go:117] "RemoveContainer" containerID="d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847" Jul 21 18:54:54.706443 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.706423 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847"} err="failed to get container status \"d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847\": rpc error: code = NotFound desc = could not find container \"d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847\": container with ID starting with d2bdb4a64d672db84cca0c6e20e2397f9e32fc0440840ce6de21fc6268b1f847 not found: ID does not exist" Jul 21 18:54:54.706510 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.706446 2556 scope.go:117] "RemoveContainer" containerID="1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa" Jul 21 18:54:54.706661 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.706645 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa"} err="failed to get container status \"1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa\": rpc error: code = NotFound desc = could not find container \"1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa\": container with ID starting with 1fe7cd6d920bdd285a8a36f61ab0ef293a2a3e006b3103a4125a94e112dccaaa not found: ID does not exist" Jul 21 18:54:54.706725 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.706662 2556 scope.go:117] "RemoveContainer" containerID="7b57c9a7042341d1944fe4f1c94e30e865b00832175cea1e2f93ce0e75d2d924" Jul 21 18:54:54.706883 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.706860 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b57c9a7042341d1944fe4f1c94e30e865b00832175cea1e2f93ce0e75d2d924"} err="failed to get container status \"7b57c9a7042341d1944fe4f1c94e30e865b00832175cea1e2f93ce0e75d2d924\": rpc error: code = NotFound desc = could not find container \"7b57c9a7042341d1944fe4f1c94e30e865b00832175cea1e2f93ce0e75d2d924\": container with ID starting with 7b57c9a7042341d1944fe4f1c94e30e865b00832175cea1e2f93ce0e75d2d924 not found: ID does not exist" Jul 21 18:54:54.706934 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.706884 2556 scope.go:117] "RemoveContainer" containerID="83eb0c8a8e3e3071ff968da16b72867c6d0581f2c2dd245b5c557cc8c2208692" Jul 21 18:54:54.707105 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.707088 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83eb0c8a8e3e3071ff968da16b72867c6d0581f2c2dd245b5c557cc8c2208692"} err="failed to get container status \"83eb0c8a8e3e3071ff968da16b72867c6d0581f2c2dd245b5c557cc8c2208692\": rpc error: code = NotFound desc = could not find container \"83eb0c8a8e3e3071ff968da16b72867c6d0581f2c2dd245b5c557cc8c2208692\": container with ID starting with 83eb0c8a8e3e3071ff968da16b72867c6d0581f2c2dd245b5c557cc8c2208692 not found: ID does not exist" Jul 21 18:54:54.776583 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.776556 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-ui-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:54:54.776681 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.776620 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-online-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:54:54.776681 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.776638 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtbfh\" (UniqueName: \"kubernetes.io/projected/61946f32-c093-406a-b50b-f51d784d0dc8-kube-api-access-gtbfh\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:54:54.776681 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.776655 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-offline-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:54:54.776681 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.776670 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/61946f32-c093-406a-b50b-f51d784d0dc8-feast-data\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:54:54.776810 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.776682 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/61946f32-c093-406a-b50b-f51d784d0dc8-registry-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:54:54.937973 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.937937 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv"] Jul 21 18:54:54.941142 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.941116 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-dz5nv"] Jul 21 18:54:54.980747 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.980712 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" path="/var/lib/kubelet/pods/61946f32-c093-406a-b50b-f51d784d0dc8/volumes" Jul 21 18:54:54.981340 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:54:54.981326 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" path="/var/lib/kubelet/pods/bddd9aa9-2aa0-4036-839e-90fe9a133a17/volumes" Jul 21 18:55:12.520904 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:12.520863 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc"] Jul 21 18:55:12.521464 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:12.521112 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc" podUID="4919b4ec-e461-404f-8c20-953a10b3141f" containerName="manager" containerID="cri-o://b0b2e95dc0dcf82ccfd9dd954ffab96218486180d835cd4ce343dc12c9d34896" gracePeriod=10 Jul 21 18:55:12.691578 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:12.691548 2556 generic.go:356] "Generic (PLEG): container finished" podID="4919b4ec-e461-404f-8c20-953a10b3141f" containerID="b0b2e95dc0dcf82ccfd9dd954ffab96218486180d835cd4ce343dc12c9d34896" exitCode=0 Jul 21 18:55:12.691710 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:12.691585 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc" event={"ID":"4919b4ec-e461-404f-8c20-953a10b3141f","Type":"ContainerDied","Data":"b0b2e95dc0dcf82ccfd9dd954ffab96218486180d835cd4ce343dc12c9d34896"} Jul 21 18:55:12.763532 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:12.763508 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc" Jul 21 18:55:12.942093 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:12.942053 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vk7wk\" (UniqueName: \"kubernetes.io/projected/4919b4ec-e461-404f-8c20-953a10b3141f-kube-api-access-vk7wk\") pod \"4919b4ec-e461-404f-8c20-953a10b3141f\" (UID: \"4919b4ec-e461-404f-8c20-953a10b3141f\") " Jul 21 18:55:12.944278 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:12.944243 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4919b4ec-e461-404f-8c20-953a10b3141f-kube-api-access-vk7wk" (OuterVolumeSpecName: "kube-api-access-vk7wk") pod "4919b4ec-e461-404f-8c20-953a10b3141f" (UID: "4919b4ec-e461-404f-8c20-953a10b3141f"). InnerVolumeSpecName "kube-api-access-vk7wk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:55:13.042979 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:13.042947 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vk7wk\" (UniqueName: \"kubernetes.io/projected/4919b4ec-e461-404f-8c20-953a10b3141f-kube-api-access-vk7wk\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:55:13.699251 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:13.699218 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc" event={"ID":"4919b4ec-e461-404f-8c20-953a10b3141f","Type":"ContainerDied","Data":"faed93951c4196c5bd8e8ba3314e9800c52791d2f99697dd30f68c2c3aaa3ba7"} Jul 21 18:55:13.699251 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:13.699252 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc" Jul 21 18:55:13.699771 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:13.699299 2556 scope.go:117] "RemoveContainer" containerID="b0b2e95dc0dcf82ccfd9dd954ffab96218486180d835cd4ce343dc12c9d34896" Jul 21 18:55:13.715726 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:13.715701 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc"] Jul 21 18:55:13.721489 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:13.721466 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-5kprc"] Jul 21 18:55:14.980181 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:14.980146 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4919b4ec-e461-404f-8c20-953a10b3141f" path="/var/lib/kubelet/pods/4919b4ec-e461-404f-8c20-953a10b3141f/volumes" Jul 21 18:55:17.173353 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173321 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-nt4z9"] Jul 21 18:55:17.173766 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173748 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="ui" Jul 21 18:55:17.173817 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173771 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="ui" Jul 21 18:55:17.173817 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173793 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="online" Jul 21 18:55:17.173817 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173803 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="online" Jul 21 18:55:17.173817 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173814 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="offline" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173824 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="offline" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173840 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="registry" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173871 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="registry" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173881 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="ui" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173890 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="ui" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173903 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="online" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173911 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="online" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173926 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="feast-apply" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173935 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="feast-apply" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173944 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="feast-init" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173952 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="feast-init" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173963 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="feast-init" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173972 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="feast-init" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173983 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="offline" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.173991 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="offline" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.174001 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4919b4ec-e461-404f-8c20-953a10b3141f" containerName="manager" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.174010 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4919b4ec-e461-404f-8c20-953a10b3141f" containerName="manager" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.174017 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="feast-apply" Jul 21 18:55:17.174063 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.174025 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="feast-apply" Jul 21 18:55:17.174655 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.174106 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="offline" Jul 21 18:55:17.174655 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.174116 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="ui" Jul 21 18:55:17.174655 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.174124 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="online" Jul 21 18:55:17.174655 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.174134 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="registry" Jul 21 18:55:17.174655 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.174143 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="offline" Jul 21 18:55:17.174655 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.174151 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4919b4ec-e461-404f-8c20-953a10b3141f" containerName="manager" Jul 21 18:55:17.174655 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.174160 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="61946f32-c093-406a-b50b-f51d784d0dc8" containerName="ui" Jul 21 18:55:17.174655 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.174168 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bddd9aa9-2aa0-4036-839e-90fe9a133a17" containerName="online" Jul 21 18:55:17.177380 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.177361 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-nt4z9" Jul 21 18:55:17.179788 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.179720 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jul 21 18:55:17.179788 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.179757 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jul 21 18:55:17.180639 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.180622 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-cnntn\"" Jul 21 18:55:17.184661 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.184635 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-nt4z9"] Jul 21 18:55:17.281005 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.280958 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7tgv\" (UniqueName: \"kubernetes.io/projected/37a46404-8591-447e-95f6-1eb0f4cee3f1-kube-api-access-h7tgv\") pod \"feast-operator-controller-manager-7495bcd-nt4z9\" (UID: \"37a46404-8591-447e-95f6-1eb0f4cee3f1\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-nt4z9" Jul 21 18:55:17.381362 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.381323 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7tgv\" (UniqueName: \"kubernetes.io/projected/37a46404-8591-447e-95f6-1eb0f4cee3f1-kube-api-access-h7tgv\") pod \"feast-operator-controller-manager-7495bcd-nt4z9\" (UID: \"37a46404-8591-447e-95f6-1eb0f4cee3f1\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-nt4z9" Jul 21 18:55:17.395972 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.395945 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7tgv\" (UniqueName: \"kubernetes.io/projected/37a46404-8591-447e-95f6-1eb0f4cee3f1-kube-api-access-h7tgv\") pod \"feast-operator-controller-manager-7495bcd-nt4z9\" (UID: \"37a46404-8591-447e-95f6-1eb0f4cee3f1\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-nt4z9" Jul 21 18:55:17.488773 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.488691 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-nt4z9" Jul 21 18:55:17.616974 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.616939 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-nt4z9"] Jul 21 18:55:17.620189 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:55:17.620151 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a46404_8591_447e_95f6_1eb0f4cee3f1.slice/crio-d2df66f38f81d779416cbd6ac8a933601d3e5a42afb5bd281de7cdb73715e6f0 WatchSource:0}: Error finding container d2df66f38f81d779416cbd6ac8a933601d3e5a42afb5bd281de7cdb73715e6f0: Status 404 returned error can't find the container with id d2df66f38f81d779416cbd6ac8a933601d3e5a42afb5bd281de7cdb73715e6f0 Jul 21 18:55:17.717792 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.717757 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-nt4z9" event={"ID":"37a46404-8591-447e-95f6-1eb0f4cee3f1","Type":"ContainerStarted","Data":"1881970bb0f4bc7f76fcb7c6a19d43c2712fd801d52d38a1d2c12ac0f9f0c46b"} Jul 21 18:55:17.717974 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.717957 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-nt4z9" Jul 21 18:55:17.718057 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.718000 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-nt4z9" event={"ID":"37a46404-8591-447e-95f6-1eb0f4cee3f1","Type":"ContainerStarted","Data":"d2df66f38f81d779416cbd6ac8a933601d3e5a42afb5bd281de7cdb73715e6f0"} Jul 21 18:55:17.733838 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:17.733787 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-nt4z9" podStartSLOduration=0.733769978 podStartE2EDuration="733.769978ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:55:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:55:17.732309417 +0000 UTC m=+1480.794389029" watchObservedRunningTime="2026-07-21 18:55:17.733769978 +0000 UTC m=+1480.795849585" Jul 21 18:55:28.723635 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:28.723606 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-nt4z9" Jul 21 18:55:35.260981 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.260948 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw"] Jul 21 18:55:35.264650 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.264633 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.267134 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.267107 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jul 21 18:55:35.267306 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.267108 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jul 21 18:55:35.267306 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.267167 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-p2lgt\"" Jul 21 18:55:35.267306 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.267262 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jul 21 18:55:35.267504 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.267383 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 21 18:55:35.267504 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.267448 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jul 21 18:55:35.267504 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.267483 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 21 18:55:35.279141 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.279118 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw"] Jul 21 18:55:35.313978 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.313945 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.314140 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.313979 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d41f1f2b-f40d-4b6b-9c43-9849d8140986-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.314140 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.314069 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.314140 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.314120 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlbsm\" (UniqueName: \"kubernetes.io/projected/d41f1f2b-f40d-4b6b-9c43-9849d8140986-kube-api-access-qlbsm\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.314258 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.314176 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.314258 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.314220 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.415424 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.415383 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.415424 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.415431 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlbsm\" (UniqueName: \"kubernetes.io/projected/d41f1f2b-f40d-4b6b-9c43-9849d8140986-kube-api-access-qlbsm\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.415640 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.415466 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.415640 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.415497 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.415640 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.415547 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.415640 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.415583 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d41f1f2b-f40d-4b6b-9c43-9849d8140986-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.415836 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:55:35.415747 2556 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Jul 21 18:55:35.415934 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:55:35.415867 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-online-tls podName:d41f1f2b-f40d-4b6b-9c43-9849d8140986 nodeName:}" failed. No retries permitted until 2026-07-21 18:55:35.915820168 +0000 UTC m=+1498.977899767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-online-tls") pod "feast-simple-feast-setup-777d6cc998-vz4pw" (UID: "d41f1f2b-f40d-4b6b-9c43-9849d8140986") : secret "feast-simple-feast-setup-online-tls" not found Jul 21 18:55:35.416035 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.416005 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d41f1f2b-f40d-4b6b-9c43-9849d8140986-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.418001 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.417982 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.418150 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.418131 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.418193 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.418131 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.423438 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.423417 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlbsm\" (UniqueName: \"kubernetes.io/projected/d41f1f2b-f40d-4b6b-9c43-9849d8140986-kube-api-access-qlbsm\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.920422 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.920390 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:35.922748 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:35.922718 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-vz4pw\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:36.191840 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:36.191753 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:36.329465 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:36.329441 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw"] Jul 21 18:55:36.331327 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:55:36.331298 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd41f1f2b_f40d_4b6b_9c43_9849d8140986.slice/crio-01bedb1e92d0f8c4175cffcc8680bf804d95e833e3847630440d69922527a0ae WatchSource:0}: Error finding container 01bedb1e92d0f8c4175cffcc8680bf804d95e833e3847630440d69922527a0ae: Status 404 returned error can't find the container with id 01bedb1e92d0f8c4175cffcc8680bf804d95e833e3847630440d69922527a0ae Jul 21 18:55:36.798197 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:36.798163 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" event={"ID":"d41f1f2b-f40d-4b6b-9c43-9849d8140986","Type":"ContainerStarted","Data":"b6531439900a5eed24035a9829dcf5ade291380be298b3ddf011f57b8459f6a1"} Jul 21 18:55:36.798393 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:36.798219 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" event={"ID":"d41f1f2b-f40d-4b6b-9c43-9849d8140986","Type":"ContainerStarted","Data":"01bedb1e92d0f8c4175cffcc8680bf804d95e833e3847630440d69922527a0ae"} Jul 21 18:55:41.819677 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:41.819645 2556 generic.go:356] "Generic (PLEG): container finished" podID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerID="b6531439900a5eed24035a9829dcf5ade291380be298b3ddf011f57b8459f6a1" exitCode=0 Jul 21 18:55:41.820044 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:41.819682 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" event={"ID":"d41f1f2b-f40d-4b6b-9c43-9849d8140986","Type":"ContainerDied","Data":"b6531439900a5eed24035a9829dcf5ade291380be298b3ddf011f57b8459f6a1"} Jul 21 18:55:42.831132 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:42.831086 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" event={"ID":"d41f1f2b-f40d-4b6b-9c43-9849d8140986","Type":"ContainerStarted","Data":"99efc2025acdc1da6bf16872dfe589535f0c781786f200ef98c491b5da34f218"} Jul 21 18:55:47.851960 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:47.851928 2556 generic.go:356] "Generic (PLEG): container finished" podID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerID="99efc2025acdc1da6bf16872dfe589535f0c781786f200ef98c491b5da34f218" exitCode=0 Jul 21 18:55:47.852355 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:47.852000 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" event={"ID":"d41f1f2b-f40d-4b6b-9c43-9849d8140986","Type":"ContainerDied","Data":"99efc2025acdc1da6bf16872dfe589535f0c781786f200ef98c491b5da34f218"} Jul 21 18:55:48.862127 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:48.862086 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" event={"ID":"d41f1f2b-f40d-4b6b-9c43-9849d8140986","Type":"ContainerStarted","Data":"7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0"} Jul 21 18:55:48.862691 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:48.862660 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" event={"ID":"d41f1f2b-f40d-4b6b-9c43-9849d8140986","Type":"ContainerStarted","Data":"0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116"} Jul 21 18:55:48.862832 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:48.862700 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" event={"ID":"d41f1f2b-f40d-4b6b-9c43-9849d8140986","Type":"ContainerStarted","Data":"4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb"} Jul 21 18:55:48.862832 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:48.862722 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" event={"ID":"d41f1f2b-f40d-4b6b-9c43-9849d8140986","Type":"ContainerStarted","Data":"6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9"} Jul 21 18:55:48.891278 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:48.891213 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" podStartSLOduration=13.8911889 podStartE2EDuration="13.8911889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:55:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:55:48.890732581 +0000 UTC m=+1511.952812189" watchObservedRunningTime="2026-07-21 18:55:48.8911889 +0000 UTC m=+1511.953268509" Jul 21 18:55:51.193095 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:51.192982 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:51.193095 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:51.193047 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:51.193095 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:51.193067 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:51.194137 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:51.194099 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:51.194881 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:51.194826 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Jul 21 18:55:51.194995 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:51.194876 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused" Jul 21 18:55:51.194995 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:51.194893 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.25:8816: connect: connection refused" Jul 21 18:55:51.194995 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:51.194832 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Jul 21 18:55:54.192394 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:54.192344 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Jul 21 18:55:54.193058 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:54.193036 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:54.193200 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:54.193161 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:54.193575 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:54.193551 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:54.193701 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:54.193591 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:54.194023 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:54.194000 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:54.194099 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:54.194073 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:54.198681 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:54.198657 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:54.895080 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:54.895027 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:54.898351 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:54.898330 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:56.192968 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:56.192924 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:57.192966 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:57.192938 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:55:57.909026 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:55:57.909001 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:56:39.012321 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:39.012294 2556 scope.go:117] "RemoveContainer" containerID="3ac0af2367f87ba7b92a0aad0ab47b8b8c1a7a9405e7c4adbff2e83e8bf42c3d" Jul 21 18:56:39.020502 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:39.020480 2556 scope.go:117] "RemoveContainer" containerID="f58bf45c2e386b5148f338735c93c2408a68d7a6c4b8169a44aaa9a65eadfcc5" Jul 21 18:56:39.027913 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:39.027893 2556 scope.go:117] "RemoveContainer" containerID="2fdd7e63bff42b8641f31106376ec65e8929f198875bac689a8f3c3a65ff4ce3" Jul 21 18:56:39.035372 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:39.035352 2556 scope.go:117] "RemoveContainer" containerID="21e2933afa5c97e434119453f76da350da5921335eeef36300e2889c5ec9a2ad" Jul 21 18:56:39.042682 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:39.042665 2556 scope.go:117] "RemoveContainer" containerID="e99b8b056a1beb2be7f905bb653c20c16bc39395bf01c9b50bbf4c6a231d27ac" Jul 21 18:56:39.051593 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:39.051570 2556 scope.go:117] "RemoveContainer" containerID="778c2b6b5d911b9d2eca1d7018c74a96b578d4e97eeafa625d8dedeca828ce5f" Jul 21 18:56:59.311011 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.310974 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw"] Jul 21 18:56:59.311494 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.311282 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="ui" containerID="cri-o://7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0" gracePeriod=30 Jul 21 18:56:59.311494 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.311309 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="offline" containerID="cri-o://0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116" gracePeriod=30 Jul 21 18:56:59.311494 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.311267 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="registry" containerID="cri-o://6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9" gracePeriod=30 Jul 21 18:56:59.311494 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.311312 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="online" containerID="cri-o://4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb" gracePeriod=30 Jul 21 18:56:59.600617 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.600575 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7"] Jul 21 18:56:59.605945 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.605921 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.608285 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.608261 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-rxtnx\"" Jul 21 18:56:59.616541 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.616512 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7"] Jul 21 18:56:59.746090 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.746053 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz9ts\" (UniqueName: \"kubernetes.io/projected/4744182d-ac0a-456d-9420-122d2ede8214-kube-api-access-dz9ts\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.746090 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.746101 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.746355 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.746177 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.746355 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.746226 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.746355 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.746265 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.746355 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.746303 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4744182d-ac0a-456d-9420-122d2ede8214-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.847169 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.847124 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.847354 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.847328 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.847434 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.847416 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.847502 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.847447 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4744182d-ac0a-456d-9420-122d2ede8214-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.847502 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.847493 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz9ts\" (UniqueName: \"kubernetes.io/projected/4744182d-ac0a-456d-9420-122d2ede8214-kube-api-access-dz9ts\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.847738 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.847551 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.847944 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.847808 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4744182d-ac0a-456d-9420-122d2ede8214-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.850116 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.850060 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.850238 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.850133 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.850238 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.850198 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.850422 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.850404 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.855293 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.855227 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz9ts\" (UniqueName: \"kubernetes.io/projected/4744182d-ac0a-456d-9420-122d2ede8214-kube-api-access-dz9ts\") pod \"feast-simple-feast-setup-777d6cc998-sjkz7\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:56:59.915688 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:56:59.915647 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:57:00.058788 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:00.058761 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7"] Jul 21 18:57:00.060711 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:57:00.060687 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4744182d_ac0a_456d_9420_122d2ede8214.slice/crio-3b3389a4df3af5a46bc576ccfc5f9e1e5ff788ae7323f5e4fadc228a2dd896e7 WatchSource:0}: Error finding container 3b3389a4df3af5a46bc576ccfc5f9e1e5ff788ae7323f5e4fadc228a2dd896e7: Status 404 returned error can't find the container with id 3b3389a4df3af5a46bc576ccfc5f9e1e5ff788ae7323f5e4fadc228a2dd896e7 Jul 21 18:57:00.152509 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:00.152461 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" event={"ID":"4744182d-ac0a-456d-9420-122d2ede8214","Type":"ContainerStarted","Data":"8aa2e4d186e3bbb2e2bf3ae410f00698abf775be4eb6319bd58a72846dc60a88"} Jul 21 18:57:00.152701 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:00.152519 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" event={"ID":"4744182d-ac0a-456d-9420-122d2ede8214","Type":"ContainerStarted","Data":"3b3389a4df3af5a46bc576ccfc5f9e1e5ff788ae7323f5e4fadc228a2dd896e7"} Jul 21 18:57:00.155515 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:00.155478 2556 generic.go:356] "Generic (PLEG): container finished" podID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerID="7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0" exitCode=0 Jul 21 18:57:00.155515 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:00.155498 2556 generic.go:356] "Generic (PLEG): container finished" podID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerID="4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb" exitCode=0 Jul 21 18:57:00.155711 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:00.155537 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" event={"ID":"d41f1f2b-f40d-4b6b-9c43-9849d8140986","Type":"ContainerDied","Data":"7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0"} Jul 21 18:57:00.155711 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:00.155563 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" event={"ID":"d41f1f2b-f40d-4b6b-9c43-9849d8140986","Type":"ContainerDied","Data":"4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb"} Jul 21 18:57:04.895287 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:04.895238 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Jul 21 18:57:05.178330 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:05.178242 2556 generic.go:356] "Generic (PLEG): container finished" podID="4744182d-ac0a-456d-9420-122d2ede8214" containerID="8aa2e4d186e3bbb2e2bf3ae410f00698abf775be4eb6319bd58a72846dc60a88" exitCode=0 Jul 21 18:57:05.178330 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:05.178308 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" event={"ID":"4744182d-ac0a-456d-9420-122d2ede8214","Type":"ContainerDied","Data":"8aa2e4d186e3bbb2e2bf3ae410f00698abf775be4eb6319bd58a72846dc60a88"} Jul 21 18:57:06.185413 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:06.185371 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" event={"ID":"4744182d-ac0a-456d-9420-122d2ede8214","Type":"ContainerStarted","Data":"4186c8a63838e5566b30df73d974b57f3cfcdd495c851ba78dc796fff0f224fa"} Jul 21 18:57:07.908909 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:07.908863 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Jul 21 18:57:11.214234 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:11.214146 2556 generic.go:356] "Generic (PLEG): container finished" podID="4744182d-ac0a-456d-9420-122d2ede8214" containerID="4186c8a63838e5566b30df73d974b57f3cfcdd495c851ba78dc796fff0f224fa" exitCode=0 Jul 21 18:57:11.214234 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:11.214219 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" event={"ID":"4744182d-ac0a-456d-9420-122d2ede8214","Type":"ContainerDied","Data":"4186c8a63838e5566b30df73d974b57f3cfcdd495c851ba78dc796fff0f224fa"} Jul 21 18:57:12.224070 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:12.223988 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" event={"ID":"4744182d-ac0a-456d-9420-122d2ede8214","Type":"ContainerStarted","Data":"cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3"} Jul 21 18:57:12.224070 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:12.224045 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" event={"ID":"4744182d-ac0a-456d-9420-122d2ede8214","Type":"ContainerStarted","Data":"e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c"} Jul 21 18:57:12.224070 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:12.224067 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" event={"ID":"4744182d-ac0a-456d-9420-122d2ede8214","Type":"ContainerStarted","Data":"cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4"} Jul 21 18:57:12.224669 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:12.224085 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" event={"ID":"4744182d-ac0a-456d-9420-122d2ede8214","Type":"ContainerStarted","Data":"aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea"} Jul 21 18:57:12.248064 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:12.247995 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" podStartSLOduration=13.247972266 podStartE2EDuration="13.247972266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:56:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:57:12.246791763 +0000 UTC m=+1595.308871395" watchObservedRunningTime="2026-07-21 18:57:12.247972266 +0000 UTC m=+1595.310051876" Jul 21 18:57:14.895595 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:14.895546 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Jul 21 18:57:14.916571 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:14.916535 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:57:14.916867 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:14.916824 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:57:14.917001 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:14.916874 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:57:14.917001 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:14.916893 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:57:14.918951 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:14.918916 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.26:6571: connect: connection refused" Jul 21 18:57:14.918951 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:14.918935 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Jul 21 18:57:14.919147 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:14.919037 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Jul 21 18:57:14.919147 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:14.919043 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.26:8816: connect: connection refused" Jul 21 18:57:17.909309 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:17.909264 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Jul 21 18:57:17.917137 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:17.917107 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:57:17.917274 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:17.917233 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:57:17.917649 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:17.917617 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:57:17.917782 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:17.917669 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:57:17.917782 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:17.917691 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:57:17.917782 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:17.917710 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:57:17.918011 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:17.917989 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:57:17.918102 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:17.918057 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:57:17.918142 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:17.918104 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:57:17.922599 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:17.922576 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:57:18.256962 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:18.256876 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:57:18.260006 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:18.259973 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 18:57:24.895701 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:24.895648 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Jul 21 18:57:24.896219 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:24.895809 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:57:27.908578 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:27.908535 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Jul 21 18:57:27.909062 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:27.908651 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:57:29.969838 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:29.969813 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:57:30.112151 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.112064 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-registry-tls\") pod \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " Jul 21 18:57:30.112151 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.112105 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-online-tls\") pod \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " Jul 21 18:57:30.112151 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.112146 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-offline-tls\") pod \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " Jul 21 18:57:30.112418 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.112224 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlbsm\" (UniqueName: \"kubernetes.io/projected/d41f1f2b-f40d-4b6b-9c43-9849d8140986-kube-api-access-qlbsm\") pod \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " Jul 21 18:57:30.112418 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.112257 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d41f1f2b-f40d-4b6b-9c43-9849d8140986-feast-data\") pod \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " Jul 21 18:57:30.112418 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.112278 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-ui-tls\") pod \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\" (UID: \"d41f1f2b-f40d-4b6b-9c43-9849d8140986\") " Jul 21 18:57:30.112964 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.112895 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d41f1f2b-f40d-4b6b-9c43-9849d8140986-feast-data" (OuterVolumeSpecName: "feast-data") pod "d41f1f2b-f40d-4b6b-9c43-9849d8140986" (UID: "d41f1f2b-f40d-4b6b-9c43-9849d8140986"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:57:30.114346 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.114306 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d41f1f2b-f40d-4b6b-9c43-9849d8140986" (UID: "d41f1f2b-f40d-4b6b-9c43-9849d8140986"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:57:30.114734 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.114697 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "d41f1f2b-f40d-4b6b-9c43-9849d8140986" (UID: "d41f1f2b-f40d-4b6b-9c43-9849d8140986"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:57:30.114734 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.114719 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-online-tls" (OuterVolumeSpecName: "online-tls") pod "d41f1f2b-f40d-4b6b-9c43-9849d8140986" (UID: "d41f1f2b-f40d-4b6b-9c43-9849d8140986"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:57:30.114830 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.114795 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d41f1f2b-f40d-4b6b-9c43-9849d8140986-kube-api-access-qlbsm" (OuterVolumeSpecName: "kube-api-access-qlbsm") pod "d41f1f2b-f40d-4b6b-9c43-9849d8140986" (UID: "d41f1f2b-f40d-4b6b-9c43-9849d8140986"). InnerVolumeSpecName "kube-api-access-qlbsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:57:30.114830 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.114806 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "d41f1f2b-f40d-4b6b-9c43-9849d8140986" (UID: "d41f1f2b-f40d-4b6b-9c43-9849d8140986"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:57:30.213465 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.213423 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlbsm\" (UniqueName: \"kubernetes.io/projected/d41f1f2b-f40d-4b6b-9c43-9849d8140986-kube-api-access-qlbsm\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:57:30.213465 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.213460 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d41f1f2b-f40d-4b6b-9c43-9849d8140986-feast-data\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:57:30.213465 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.213471 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-ui-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:57:30.213465 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.213478 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-registry-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:57:30.213731 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.213486 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-online-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:57:30.213731 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.213493 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d41f1f2b-f40d-4b6b-9c43-9849d8140986-offline-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 18:57:30.307880 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.307836 2556 generic.go:356] "Generic (PLEG): container finished" podID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerID="0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116" exitCode=137 Jul 21 18:57:30.307880 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.307877 2556 generic.go:356] "Generic (PLEG): container finished" podID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerID="6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9" exitCode=137 Jul 21 18:57:30.308079 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.307881 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" event={"ID":"d41f1f2b-f40d-4b6b-9c43-9849d8140986","Type":"ContainerDied","Data":"0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116"} Jul 21 18:57:30.308079 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.307922 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" Jul 21 18:57:30.308079 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.307939 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" event={"ID":"d41f1f2b-f40d-4b6b-9c43-9849d8140986","Type":"ContainerDied","Data":"6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9"} Jul 21 18:57:30.308079 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.307954 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw" event={"ID":"d41f1f2b-f40d-4b6b-9c43-9849d8140986","Type":"ContainerDied","Data":"01bedb1e92d0f8c4175cffcc8680bf804d95e833e3847630440d69922527a0ae"} Jul 21 18:57:30.308079 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.307972 2556 scope.go:117] "RemoveContainer" containerID="7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0" Jul 21 18:57:30.317429 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.317257 2556 scope.go:117] "RemoveContainer" containerID="0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116" Jul 21 18:57:30.326088 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.326070 2556 scope.go:117] "RemoveContainer" containerID="4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb" Jul 21 18:57:30.331238 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.331207 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw"] Jul 21 18:57:30.336320 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.336226 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vz4pw"] Jul 21 18:57:30.340671 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.340646 2556 scope.go:117] "RemoveContainer" containerID="6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9" Jul 21 18:57:30.348105 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.348091 2556 scope.go:117] "RemoveContainer" containerID="99efc2025acdc1da6bf16872dfe589535f0c781786f200ef98c491b5da34f218" Jul 21 18:57:30.355230 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.355211 2556 scope.go:117] "RemoveContainer" containerID="b6531439900a5eed24035a9829dcf5ade291380be298b3ddf011f57b8459f6a1" Jul 21 18:57:30.362230 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.362191 2556 scope.go:117] "RemoveContainer" containerID="7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0" Jul 21 18:57:30.362442 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:57:30.362426 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0\": container with ID starting with 7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0 not found: ID does not exist" containerID="7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0" Jul 21 18:57:30.362493 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.362450 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0"} err="failed to get container status \"7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0\": rpc error: code = NotFound desc = could not find container \"7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0\": container with ID starting with 7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0 not found: ID does not exist" Jul 21 18:57:30.362493 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.362468 2556 scope.go:117] "RemoveContainer" containerID="0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116" Jul 21 18:57:30.362686 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:57:30.362672 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116\": container with ID starting with 0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116 not found: ID does not exist" containerID="0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116" Jul 21 18:57:30.362726 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.362689 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116"} err="failed to get container status \"0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116\": rpc error: code = NotFound desc = could not find container \"0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116\": container with ID starting with 0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116 not found: ID does not exist" Jul 21 18:57:30.362726 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.362702 2556 scope.go:117] "RemoveContainer" containerID="4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb" Jul 21 18:57:30.362916 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:57:30.362897 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb\": container with ID starting with 4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb not found: ID does not exist" containerID="4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb" Jul 21 18:57:30.362960 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.362920 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb"} err="failed to get container status \"4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb\": rpc error: code = NotFound desc = could not find container \"4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb\": container with ID starting with 4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb not found: ID does not exist" Jul 21 18:57:30.362960 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.362935 2556 scope.go:117] "RemoveContainer" containerID="6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9" Jul 21 18:57:30.363166 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:57:30.363146 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9\": container with ID starting with 6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9 not found: ID does not exist" containerID="6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9" Jul 21 18:57:30.363211 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.363174 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9"} err="failed to get container status \"6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9\": rpc error: code = NotFound desc = could not find container \"6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9\": container with ID starting with 6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9 not found: ID does not exist" Jul 21 18:57:30.363211 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.363191 2556 scope.go:117] "RemoveContainer" containerID="99efc2025acdc1da6bf16872dfe589535f0c781786f200ef98c491b5da34f218" Jul 21 18:57:30.363446 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:57:30.363429 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99efc2025acdc1da6bf16872dfe589535f0c781786f200ef98c491b5da34f218\": container with ID starting with 99efc2025acdc1da6bf16872dfe589535f0c781786f200ef98c491b5da34f218 not found: ID does not exist" containerID="99efc2025acdc1da6bf16872dfe589535f0c781786f200ef98c491b5da34f218" Jul 21 18:57:30.363484 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.363451 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99efc2025acdc1da6bf16872dfe589535f0c781786f200ef98c491b5da34f218"} err="failed to get container status \"99efc2025acdc1da6bf16872dfe589535f0c781786f200ef98c491b5da34f218\": rpc error: code = NotFound desc = could not find container \"99efc2025acdc1da6bf16872dfe589535f0c781786f200ef98c491b5da34f218\": container with ID starting with 99efc2025acdc1da6bf16872dfe589535f0c781786f200ef98c491b5da34f218 not found: ID does not exist" Jul 21 18:57:30.363484 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.363465 2556 scope.go:117] "RemoveContainer" containerID="b6531439900a5eed24035a9829dcf5ade291380be298b3ddf011f57b8459f6a1" Jul 21 18:57:30.363828 ip-10-0-136-34 kubenswrapper[2556]: E0721 18:57:30.363688 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6531439900a5eed24035a9829dcf5ade291380be298b3ddf011f57b8459f6a1\": container with ID starting with b6531439900a5eed24035a9829dcf5ade291380be298b3ddf011f57b8459f6a1 not found: ID does not exist" containerID="b6531439900a5eed24035a9829dcf5ade291380be298b3ddf011f57b8459f6a1" Jul 21 18:57:30.363828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.363703 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6531439900a5eed24035a9829dcf5ade291380be298b3ddf011f57b8459f6a1"} err="failed to get container status \"b6531439900a5eed24035a9829dcf5ade291380be298b3ddf011f57b8459f6a1\": rpc error: code = NotFound desc = could not find container \"b6531439900a5eed24035a9829dcf5ade291380be298b3ddf011f57b8459f6a1\": container with ID starting with b6531439900a5eed24035a9829dcf5ade291380be298b3ddf011f57b8459f6a1 not found: ID does not exist" Jul 21 18:57:30.363828 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.363715 2556 scope.go:117] "RemoveContainer" containerID="7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0" Jul 21 18:57:30.363987 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.363968 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0"} err="failed to get container status \"7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0\": rpc error: code = NotFound desc = could not find container \"7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0\": container with ID starting with 7f910a8533f56ac6b360e2a3c598fe31b030eb8522534c44fd369372d023e0c0 not found: ID does not exist" Jul 21 18:57:30.363987 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.363981 2556 scope.go:117] "RemoveContainer" containerID="0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116" Jul 21 18:57:30.364198 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.364180 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116"} err="failed to get container status \"0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116\": rpc error: code = NotFound desc = could not find container \"0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116\": container with ID starting with 0016831b87d26dcc83bef7ec0da584ee6082dea7ef1fd9d3dbab3e501444a116 not found: ID does not exist" Jul 21 18:57:30.364198 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.364197 2556 scope.go:117] "RemoveContainer" containerID="4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb" Jul 21 18:57:30.364409 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.364386 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb"} err="failed to get container status \"4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb\": rpc error: code = NotFound desc = could not find container \"4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb\": container with ID starting with 4505adac60d004eb7ad65b36cfb2d2b98900386df3f425d9f94c6bf42af23bdb not found: ID does not exist" Jul 21 18:57:30.364452 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.364410 2556 scope.go:117] "RemoveContainer" containerID="6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9" Jul 21 18:57:30.364586 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.364567 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9"} err="failed to get container status \"6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9\": rpc error: code = NotFound desc = could not find container \"6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9\": container with ID starting with 6fb805444a3b72bcffe7d4daeb27bf0e7737ca055761f73bc3df1a347df427c9 not found: ID does not exist" Jul 21 18:57:30.364662 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.364589 2556 scope.go:117] "RemoveContainer" containerID="99efc2025acdc1da6bf16872dfe589535f0c781786f200ef98c491b5da34f218" Jul 21 18:57:30.364812 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.364798 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99efc2025acdc1da6bf16872dfe589535f0c781786f200ef98c491b5da34f218"} err="failed to get container status \"99efc2025acdc1da6bf16872dfe589535f0c781786f200ef98c491b5da34f218\": rpc error: code = NotFound desc = could not find container \"99efc2025acdc1da6bf16872dfe589535f0c781786f200ef98c491b5da34f218\": container with ID starting with 99efc2025acdc1da6bf16872dfe589535f0c781786f200ef98c491b5da34f218 not found: ID does not exist" Jul 21 18:57:30.364879 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.364812 2556 scope.go:117] "RemoveContainer" containerID="b6531439900a5eed24035a9829dcf5ade291380be298b3ddf011f57b8459f6a1" Jul 21 18:57:30.365078 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.365057 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6531439900a5eed24035a9829dcf5ade291380be298b3ddf011f57b8459f6a1"} err="failed to get container status \"b6531439900a5eed24035a9829dcf5ade291380be298b3ddf011f57b8459f6a1\": rpc error: code = NotFound desc = could not find container \"b6531439900a5eed24035a9829dcf5ade291380be298b3ddf011f57b8459f6a1\": container with ID starting with b6531439900a5eed24035a9829dcf5ade291380be298b3ddf011f57b8459f6a1 not found: ID does not exist" Jul 21 18:57:30.980551 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:57:30.980511 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" path="/var/lib/kubelet/pods/d41f1f2b-f40d-4b6b-9c43-9849d8140986/volumes" Jul 21 18:58:21.123456 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.123414 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf"] Jul 21 18:58:21.124101 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.123896 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="feast-apply" Jul 21 18:58:21.124101 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.123916 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="feast-apply" Jul 21 18:58:21.124101 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.123930 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="registry" Jul 21 18:58:21.124101 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.123938 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="registry" Jul 21 18:58:21.124101 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.123953 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="feast-init" Jul 21 18:58:21.124101 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.123962 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="feast-init" Jul 21 18:58:21.124101 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.123989 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="online" Jul 21 18:58:21.124101 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.123997 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="online" Jul 21 18:58:21.124101 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.124007 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="ui" Jul 21 18:58:21.124101 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.124015 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="ui" Jul 21 18:58:21.124101 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.124030 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="offline" Jul 21 18:58:21.124101 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.124039 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="offline" Jul 21 18:58:21.124101 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.124107 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="registry" Jul 21 18:58:21.124755 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.124120 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="offline" Jul 21 18:58:21.124755 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.124129 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="online" Jul 21 18:58:21.124755 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.124140 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d41f1f2b-f40d-4b6b-9c43-9849d8140986" containerName="ui" Jul 21 18:58:21.127965 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.127943 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.130562 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.130540 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jul 21 18:58:21.131312 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.131292 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jul 21 18:58:21.131312 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.131312 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-t5cch\"" Jul 21 18:58:21.131487 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.131303 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jul 21 18:58:21.131487 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.131322 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jul 21 18:58:21.131487 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.131350 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jul 21 18:58:21.131487 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.131417 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jul 21 18:58:21.138823 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.138802 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf"] Jul 21 18:58:21.243776 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.243737 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nzf6\" (UniqueName: \"kubernetes.io/projected/8b98655e-480b-4469-b5bd-f7e96fe8df07-kube-api-access-4nzf6\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.244011 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.243783 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.244011 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.243814 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.244011 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.243918 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8b98655e-480b-4469-b5bd-f7e96fe8df07-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.244011 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.243955 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.244011 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.243986 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8b98655e-480b-4469-b5bd-f7e96fe8df07-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.344887 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.344825 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nzf6\" (UniqueName: \"kubernetes.io/projected/8b98655e-480b-4469-b5bd-f7e96fe8df07-kube-api-access-4nzf6\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.345082 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.344900 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.345082 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.344930 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.345082 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.344963 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8b98655e-480b-4469-b5bd-f7e96fe8df07-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.345082 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.344985 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.345082 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.345011 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8b98655e-480b-4469-b5bd-f7e96fe8df07-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.345493 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.345465 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8b98655e-480b-4469-b5bd-f7e96fe8df07-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.345727 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.345705 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8b98655e-480b-4469-b5bd-f7e96fe8df07-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.347443 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.347413 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.347547 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.347462 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.347625 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.347604 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.352578 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.352558 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nzf6\" (UniqueName: \"kubernetes.io/projected/8b98655e-480b-4469-b5bd-f7e96fe8df07-kube-api-access-4nzf6\") pod \"feast-simple-feast-remote-setup-db6955c6c-qmnsf\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.437437 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.437352 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:21.575645 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:21.575617 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf"] Jul 21 18:58:21.577503 ip-10-0-136-34 kubenswrapper[2556]: W0721 18:58:21.577475 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b98655e_480b_4469_b5bd_f7e96fe8df07.slice/crio-c75f38a471db22b095f441f0e85ddc0e38b739ccc85ee0a2d3760f5cb1a5609e WatchSource:0}: Error finding container c75f38a471db22b095f441f0e85ddc0e38b739ccc85ee0a2d3760f5cb1a5609e: Status 404 returned error can't find the container with id c75f38a471db22b095f441f0e85ddc0e38b739ccc85ee0a2d3760f5cb1a5609e Jul 21 18:58:22.523996 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:22.523953 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" event={"ID":"8b98655e-480b-4469-b5bd-f7e96fe8df07","Type":"ContainerStarted","Data":"98fbc5f937eb64cd364b3e1c3e4a55c8fce13cee8008771e7121f94ebdc3460e"} Jul 21 18:58:22.524373 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:22.524010 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" event={"ID":"8b98655e-480b-4469-b5bd-f7e96fe8df07","Type":"ContainerStarted","Data":"c75f38a471db22b095f441f0e85ddc0e38b739ccc85ee0a2d3760f5cb1a5609e"} Jul 21 18:58:26.541871 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:26.541820 2556 generic.go:356] "Generic (PLEG): container finished" podID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerID="98fbc5f937eb64cd364b3e1c3e4a55c8fce13cee8008771e7121f94ebdc3460e" exitCode=0 Jul 21 18:58:26.542247 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:26.541886 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" event={"ID":"8b98655e-480b-4469-b5bd-f7e96fe8df07","Type":"ContainerDied","Data":"98fbc5f937eb64cd364b3e1c3e4a55c8fce13cee8008771e7121f94ebdc3460e"} Jul 21 18:58:27.547814 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:27.547783 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" event={"ID":"8b98655e-480b-4469-b5bd-f7e96fe8df07","Type":"ContainerStarted","Data":"1ad1c6877437b8b7bb8dffb07e8d4e0f785eed95aa9c94ffcd799b5483dee083"} Jul 21 18:58:32.571171 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:32.571135 2556 generic.go:356] "Generic (PLEG): container finished" podID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerID="1ad1c6877437b8b7bb8dffb07e8d4e0f785eed95aa9c94ffcd799b5483dee083" exitCode=0 Jul 21 18:58:32.571534 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:32.571206 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" event={"ID":"8b98655e-480b-4469-b5bd-f7e96fe8df07","Type":"ContainerDied","Data":"1ad1c6877437b8b7bb8dffb07e8d4e0f785eed95aa9c94ffcd799b5483dee083"} Jul 21 18:58:33.579729 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:33.579692 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" event={"ID":"8b98655e-480b-4469-b5bd-f7e96fe8df07","Type":"ContainerStarted","Data":"38258756e6c58587e03e0e20df594ed066a201ec22f0e8643427baf7f3464f7c"} Jul 21 18:58:33.580247 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:33.579750 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" event={"ID":"8b98655e-480b-4469-b5bd-f7e96fe8df07","Type":"ContainerStarted","Data":"0a735449fcf7a966ef31e209d1eaa9de4cbeb047b87bed724abdece9c3c25e87"} Jul 21 18:58:33.580247 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:33.579771 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" event={"ID":"8b98655e-480b-4469-b5bd-f7e96fe8df07","Type":"ContainerStarted","Data":"0a52732669784e2b5afcf67a94104b7ffb5c824986fcbfaa813f5999df1641ed"} Jul 21 18:58:33.604062 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:33.604008 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" podStartSLOduration=12.603991812 podStartE2EDuration="12.603991812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:58:33.601514312 +0000 UTC m=+1676.663593932" watchObservedRunningTime="2026-07-21 18:58:33.603991812 +0000 UTC m=+1676.666071419" Jul 21 18:58:36.438517 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:36.438476 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:36.439034 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:36.438542 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:36.439034 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:36.438562 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:36.440033 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:36.439999 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused" Jul 21 18:58:36.440152 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:36.440036 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.27:8816: connect: connection refused" Jul 21 18:58:36.440152 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:36.440043 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Jul 21 18:58:39.438696 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:39.438660 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:39.439084 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:39.438872 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:39.439248 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:39.439222 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:39.439374 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:39.439261 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:39.439501 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:39.439483 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:39.439634 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:39.439618 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:39.445280 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:39.445258 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:39.610347 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:39.610317 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:58:39.615098 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:58:39.615072 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 18:59:42.174557 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:42.174527 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf"] Jul 21 18:59:42.175147 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:42.174758 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="online" containerID="cri-o://0a52732669784e2b5afcf67a94104b7ffb5c824986fcbfaa813f5999df1641ed" gracePeriod=30 Jul 21 18:59:42.175147 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:42.174804 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="offline" containerID="cri-o://0a735449fcf7a966ef31e209d1eaa9de4cbeb047b87bed724abdece9c3c25e87" gracePeriod=30 Jul 21 18:59:42.175147 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:42.174820 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="ui" containerID="cri-o://38258756e6c58587e03e0e20df594ed066a201ec22f0e8643427baf7f3464f7c" gracePeriod=30 Jul 21 18:59:42.330889 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:42.329404 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7"] Jul 21 18:59:42.330889 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:42.329759 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="registry" containerID="cri-o://aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea" gracePeriod=30 Jul 21 18:59:42.330889 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:42.330098 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="ui" containerID="cri-o://cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3" gracePeriod=30 Jul 21 18:59:42.330889 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:42.330200 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="offline" containerID="cri-o://e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c" gracePeriod=30 Jul 21 18:59:42.330889 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:42.330296 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="online" containerID="cri-o://cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4" gracePeriod=30 Jul 21 18:59:42.861342 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:42.861315 2556 generic.go:356] "Generic (PLEG): container finished" podID="4744182d-ac0a-456d-9420-122d2ede8214" containerID="cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3" exitCode=0 Jul 21 18:59:42.861461 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:42.861371 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" event={"ID":"4744182d-ac0a-456d-9420-122d2ede8214","Type":"ContainerDied","Data":"cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3"} Jul 21 18:59:42.864236 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:42.864212 2556 generic.go:356] "Generic (PLEG): container finished" podID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerID="38258756e6c58587e03e0e20df594ed066a201ec22f0e8643427baf7f3464f7c" exitCode=0 Jul 21 18:59:42.864343 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:42.864281 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" event={"ID":"8b98655e-480b-4469-b5bd-f7e96fe8df07","Type":"ContainerDied","Data":"38258756e6c58587e03e0e20df594ed066a201ec22f0e8643427baf7f3464f7c"} Jul 21 18:59:43.871684 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:43.871652 2556 generic.go:356] "Generic (PLEG): container finished" podID="4744182d-ac0a-456d-9420-122d2ede8214" containerID="cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4" exitCode=0 Jul 21 18:59:43.872103 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:43.871720 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" event={"ID":"4744182d-ac0a-456d-9420-122d2ede8214","Type":"ContainerDied","Data":"cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4"} Jul 21 18:59:43.874438 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:43.874411 2556 generic.go:356] "Generic (PLEG): container finished" podID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerID="0a52732669784e2b5afcf67a94104b7ffb5c824986fcbfaa813f5999df1641ed" exitCode=0 Jul 21 18:59:43.874572 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:43.874461 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" event={"ID":"8b98655e-480b-4469-b5bd-f7e96fe8df07","Type":"ContainerDied","Data":"0a52732669784e2b5afcf67a94104b7ffb5c824986fcbfaa813f5999df1641ed"} Jul 21 18:59:47.917765 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:47.917717 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Jul 21 18:59:48.257658 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:48.257567 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Jul 21 18:59:49.439631 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:49.439584 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused" Jul 21 18:59:49.610777 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:49.610728 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Jul 21 18:59:57.918368 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:57.918315 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Jul 21 18:59:58.258003 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:58.257902 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Jul 21 18:59:59.439451 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:59.439407 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused" Jul 21 18:59:59.610397 ip-10-0-136-34 kubenswrapper[2556]: I0721 18:59:59.610354 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Jul 21 19:00:07.918453 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:07.918407 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Jul 21 19:00:07.918915 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:07.918542 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 19:00:08.258095 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:08.257994 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Jul 21 19:00:08.258238 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:08.258190 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 19:00:09.439799 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:09.439746 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused" Jul 21 19:00:09.440243 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:09.439931 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 19:00:09.611499 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:09.611457 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Jul 21 19:00:09.611670 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:09.611574 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 19:00:12.827128 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.827105 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 19:00:12.913284 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.913254 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-offline-tls\") pod \"8b98655e-480b-4469-b5bd-f7e96fe8df07\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " Jul 21 19:00:12.913436 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.913302 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8b98655e-480b-4469-b5bd-f7e96fe8df07-feast-data\") pod \"8b98655e-480b-4469-b5bd-f7e96fe8df07\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " Jul 21 19:00:12.913436 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.913329 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-online-tls\") pod \"8b98655e-480b-4469-b5bd-f7e96fe8df07\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " Jul 21 19:00:12.913436 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.913353 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8b98655e-480b-4469-b5bd-f7e96fe8df07-registry-tls\") pod \"8b98655e-480b-4469-b5bd-f7e96fe8df07\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " Jul 21 19:00:12.913436 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.913428 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nzf6\" (UniqueName: \"kubernetes.io/projected/8b98655e-480b-4469-b5bd-f7e96fe8df07-kube-api-access-4nzf6\") pod \"8b98655e-480b-4469-b5bd-f7e96fe8df07\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " Jul 21 19:00:12.913655 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.913469 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-ui-tls\") pod \"8b98655e-480b-4469-b5bd-f7e96fe8df07\" (UID: \"8b98655e-480b-4469-b5bd-f7e96fe8df07\") " Jul 21 19:00:12.913954 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.913907 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b98655e-480b-4469-b5bd-f7e96fe8df07-feast-data" (OuterVolumeSpecName: "feast-data") pod "8b98655e-480b-4469-b5bd-f7e96fe8df07" (UID: "8b98655e-480b-4469-b5bd-f7e96fe8df07"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 19:00:12.914091 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.914026 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b98655e-480b-4469-b5bd-f7e96fe8df07-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8b98655e-480b-4469-b5bd-f7e96fe8df07" (UID: "8b98655e-480b-4469-b5bd-f7e96fe8df07"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 19:00:12.916084 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.916053 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-online-tls" (OuterVolumeSpecName: "online-tls") pod "8b98655e-480b-4469-b5bd-f7e96fe8df07" (UID: "8b98655e-480b-4469-b5bd-f7e96fe8df07"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 19:00:12.916213 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.916117 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "8b98655e-480b-4469-b5bd-f7e96fe8df07" (UID: "8b98655e-480b-4469-b5bd-f7e96fe8df07"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 19:00:12.916213 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.916125 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "8b98655e-480b-4469-b5bd-f7e96fe8df07" (UID: "8b98655e-480b-4469-b5bd-f7e96fe8df07"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 19:00:12.918388 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.918366 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b98655e-480b-4469-b5bd-f7e96fe8df07-kube-api-access-4nzf6" (OuterVolumeSpecName: "kube-api-access-4nzf6") pod "8b98655e-480b-4469-b5bd-f7e96fe8df07" (UID: "8b98655e-480b-4469-b5bd-f7e96fe8df07"). InnerVolumeSpecName "kube-api-access-4nzf6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 19:00:12.980179 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.980154 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 19:00:12.990783 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.990758 2556 generic.go:356] "Generic (PLEG): container finished" podID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerID="0a735449fcf7a966ef31e209d1eaa9de4cbeb047b87bed724abdece9c3c25e87" exitCode=137 Jul 21 19:00:12.990932 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.990812 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" Jul 21 19:00:12.990932 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.990839 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" event={"ID":"8b98655e-480b-4469-b5bd-f7e96fe8df07","Type":"ContainerDied","Data":"0a735449fcf7a966ef31e209d1eaa9de4cbeb047b87bed724abdece9c3c25e87"} Jul 21 19:00:12.990932 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.990899 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf" event={"ID":"8b98655e-480b-4469-b5bd-f7e96fe8df07","Type":"ContainerDied","Data":"c75f38a471db22b095f441f0e85ddc0e38b739ccc85ee0a2d3760f5cb1a5609e"} Jul 21 19:00:12.990932 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.990925 2556 scope.go:117] "RemoveContainer" containerID="38258756e6c58587e03e0e20df594ed066a201ec22f0e8643427baf7f3464f7c" Jul 21 19:00:12.993898 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.993872 2556 generic.go:356] "Generic (PLEG): container finished" podID="4744182d-ac0a-456d-9420-122d2ede8214" containerID="e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c" exitCode=137 Jul 21 19:00:12.993898 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.993893 2556 generic.go:356] "Generic (PLEG): container finished" podID="4744182d-ac0a-456d-9420-122d2ede8214" containerID="aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea" exitCode=137 Jul 21 19:00:12.994043 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.993910 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" event={"ID":"4744182d-ac0a-456d-9420-122d2ede8214","Type":"ContainerDied","Data":"e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c"} Jul 21 19:00:12.994043 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.993936 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" event={"ID":"4744182d-ac0a-456d-9420-122d2ede8214","Type":"ContainerDied","Data":"aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea"} Jul 21 19:00:12.994043 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.993956 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" event={"ID":"4744182d-ac0a-456d-9420-122d2ede8214","Type":"ContainerDied","Data":"3b3389a4df3af5a46bc576ccfc5f9e1e5ff788ae7323f5e4fadc228a2dd896e7"} Jul 21 19:00:12.994043 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.993937 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7" Jul 21 19:00:12.999441 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:12.999424 2556 scope.go:117] "RemoveContainer" containerID="0a735449fcf7a966ef31e209d1eaa9de4cbeb047b87bed724abdece9c3c25e87" Jul 21 19:00:13.007770 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.007752 2556 scope.go:117] "RemoveContainer" containerID="0a52732669784e2b5afcf67a94104b7ffb5c824986fcbfaa813f5999df1641ed" Jul 21 19:00:13.014050 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.014025 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-registry-tls\") pod \"4744182d-ac0a-456d-9420-122d2ede8214\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " Jul 21 19:00:13.014162 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.014066 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-ui-tls\") pod \"4744182d-ac0a-456d-9420-122d2ede8214\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " Jul 21 19:00:13.014162 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.014093 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-online-tls\") pod \"4744182d-ac0a-456d-9420-122d2ede8214\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " Jul 21 19:00:13.014162 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.014145 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4744182d-ac0a-456d-9420-122d2ede8214-feast-data\") pod \"4744182d-ac0a-456d-9420-122d2ede8214\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " Jul 21 19:00:13.014336 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.014183 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz9ts\" (UniqueName: \"kubernetes.io/projected/4744182d-ac0a-456d-9420-122d2ede8214-kube-api-access-dz9ts\") pod \"4744182d-ac0a-456d-9420-122d2ede8214\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " Jul 21 19:00:13.014336 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.014243 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-offline-tls\") pod \"4744182d-ac0a-456d-9420-122d2ede8214\" (UID: \"4744182d-ac0a-456d-9420-122d2ede8214\") " Jul 21 19:00:13.014478 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.014463 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-ui-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 19:00:13.014558 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.014483 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-offline-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 19:00:13.014558 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.014497 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8b98655e-480b-4469-b5bd-f7e96fe8df07-feast-data\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 19:00:13.014558 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.014509 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8b98655e-480b-4469-b5bd-f7e96fe8df07-online-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 19:00:13.014729 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.014651 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8b98655e-480b-4469-b5bd-f7e96fe8df07-registry-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 19:00:13.014729 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.014669 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nzf6\" (UniqueName: \"kubernetes.io/projected/8b98655e-480b-4469-b5bd-f7e96fe8df07-kube-api-access-4nzf6\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 19:00:13.023900 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.016774 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4744182d-ac0a-456d-9420-122d2ede8214-feast-data" (OuterVolumeSpecName: "feast-data") pod "4744182d-ac0a-456d-9420-122d2ede8214" (UID: "4744182d-ac0a-456d-9420-122d2ede8214"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 19:00:13.023900 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.017161 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "4744182d-ac0a-456d-9420-122d2ede8214" (UID: "4744182d-ac0a-456d-9420-122d2ede8214"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 19:00:13.023900 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.017229 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-online-tls" (OuterVolumeSpecName: "online-tls") pod "4744182d-ac0a-456d-9420-122d2ede8214" (UID: "4744182d-ac0a-456d-9420-122d2ede8214"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 19:00:13.023900 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.018444 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4744182d-ac0a-456d-9420-122d2ede8214" (UID: "4744182d-ac0a-456d-9420-122d2ede8214"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 19:00:13.023900 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.018611 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "4744182d-ac0a-456d-9420-122d2ede8214" (UID: "4744182d-ac0a-456d-9420-122d2ede8214"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 19:00:13.023900 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.018671 2556 scope.go:117] "RemoveContainer" containerID="1ad1c6877437b8b7bb8dffb07e8d4e0f785eed95aa9c94ffcd799b5483dee083" Jul 21 19:00:13.023900 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.018830 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4744182d-ac0a-456d-9420-122d2ede8214-kube-api-access-dz9ts" (OuterVolumeSpecName: "kube-api-access-dz9ts") pod "4744182d-ac0a-456d-9420-122d2ede8214" (UID: "4744182d-ac0a-456d-9420-122d2ede8214"). InnerVolumeSpecName "kube-api-access-dz9ts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 19:00:13.023900 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.021717 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf"] Jul 21 19:00:13.026405 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.025269 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-qmnsf"] Jul 21 19:00:13.031084 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.031064 2556 scope.go:117] "RemoveContainer" containerID="98fbc5f937eb64cd364b3e1c3e4a55c8fce13cee8008771e7121f94ebdc3460e" Jul 21 19:00:13.038168 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.038137 2556 scope.go:117] "RemoveContainer" containerID="38258756e6c58587e03e0e20df594ed066a201ec22f0e8643427baf7f3464f7c" Jul 21 19:00:13.038421 ip-10-0-136-34 kubenswrapper[2556]: E0721 19:00:13.038403 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38258756e6c58587e03e0e20df594ed066a201ec22f0e8643427baf7f3464f7c\": container with ID starting with 38258756e6c58587e03e0e20df594ed066a201ec22f0e8643427baf7f3464f7c not found: ID does not exist" containerID="38258756e6c58587e03e0e20df594ed066a201ec22f0e8643427baf7f3464f7c" Jul 21 19:00:13.038490 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.038433 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38258756e6c58587e03e0e20df594ed066a201ec22f0e8643427baf7f3464f7c"} err="failed to get container status \"38258756e6c58587e03e0e20df594ed066a201ec22f0e8643427baf7f3464f7c\": rpc error: code = NotFound desc = could not find container \"38258756e6c58587e03e0e20df594ed066a201ec22f0e8643427baf7f3464f7c\": container with ID starting with 38258756e6c58587e03e0e20df594ed066a201ec22f0e8643427baf7f3464f7c not found: ID does not exist" Jul 21 19:00:13.038490 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.038459 2556 scope.go:117] "RemoveContainer" containerID="0a735449fcf7a966ef31e209d1eaa9de4cbeb047b87bed724abdece9c3c25e87" Jul 21 19:00:13.038694 ip-10-0-136-34 kubenswrapper[2556]: E0721 19:00:13.038680 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a735449fcf7a966ef31e209d1eaa9de4cbeb047b87bed724abdece9c3c25e87\": container with ID starting with 0a735449fcf7a966ef31e209d1eaa9de4cbeb047b87bed724abdece9c3c25e87 not found: ID does not exist" containerID="0a735449fcf7a966ef31e209d1eaa9de4cbeb047b87bed724abdece9c3c25e87" Jul 21 19:00:13.038760 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.038700 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a735449fcf7a966ef31e209d1eaa9de4cbeb047b87bed724abdece9c3c25e87"} err="failed to get container status \"0a735449fcf7a966ef31e209d1eaa9de4cbeb047b87bed724abdece9c3c25e87\": rpc error: code = NotFound desc = could not find container \"0a735449fcf7a966ef31e209d1eaa9de4cbeb047b87bed724abdece9c3c25e87\": container with ID starting with 0a735449fcf7a966ef31e209d1eaa9de4cbeb047b87bed724abdece9c3c25e87 not found: ID does not exist" Jul 21 19:00:13.038760 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.038719 2556 scope.go:117] "RemoveContainer" containerID="0a52732669784e2b5afcf67a94104b7ffb5c824986fcbfaa813f5999df1641ed" Jul 21 19:00:13.038955 ip-10-0-136-34 kubenswrapper[2556]: E0721 19:00:13.038938 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a52732669784e2b5afcf67a94104b7ffb5c824986fcbfaa813f5999df1641ed\": container with ID starting with 0a52732669784e2b5afcf67a94104b7ffb5c824986fcbfaa813f5999df1641ed not found: ID does not exist" containerID="0a52732669784e2b5afcf67a94104b7ffb5c824986fcbfaa813f5999df1641ed" Jul 21 19:00:13.038997 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.038961 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a52732669784e2b5afcf67a94104b7ffb5c824986fcbfaa813f5999df1641ed"} err="failed to get container status \"0a52732669784e2b5afcf67a94104b7ffb5c824986fcbfaa813f5999df1641ed\": rpc error: code = NotFound desc = could not find container \"0a52732669784e2b5afcf67a94104b7ffb5c824986fcbfaa813f5999df1641ed\": container with ID starting with 0a52732669784e2b5afcf67a94104b7ffb5c824986fcbfaa813f5999df1641ed not found: ID does not exist" Jul 21 19:00:13.038997 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.038976 2556 scope.go:117] "RemoveContainer" containerID="1ad1c6877437b8b7bb8dffb07e8d4e0f785eed95aa9c94ffcd799b5483dee083" Jul 21 19:00:13.039221 ip-10-0-136-34 kubenswrapper[2556]: E0721 19:00:13.039205 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ad1c6877437b8b7bb8dffb07e8d4e0f785eed95aa9c94ffcd799b5483dee083\": container with ID starting with 1ad1c6877437b8b7bb8dffb07e8d4e0f785eed95aa9c94ffcd799b5483dee083 not found: ID does not exist" containerID="1ad1c6877437b8b7bb8dffb07e8d4e0f785eed95aa9c94ffcd799b5483dee083" Jul 21 19:00:13.039267 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.039226 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad1c6877437b8b7bb8dffb07e8d4e0f785eed95aa9c94ffcd799b5483dee083"} err="failed to get container status \"1ad1c6877437b8b7bb8dffb07e8d4e0f785eed95aa9c94ffcd799b5483dee083\": rpc error: code = NotFound desc = could not find container \"1ad1c6877437b8b7bb8dffb07e8d4e0f785eed95aa9c94ffcd799b5483dee083\": container with ID starting with 1ad1c6877437b8b7bb8dffb07e8d4e0f785eed95aa9c94ffcd799b5483dee083 not found: ID does not exist" Jul 21 19:00:13.039267 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.039240 2556 scope.go:117] "RemoveContainer" containerID="98fbc5f937eb64cd364b3e1c3e4a55c8fce13cee8008771e7121f94ebdc3460e" Jul 21 19:00:13.039446 ip-10-0-136-34 kubenswrapper[2556]: E0721 19:00:13.039430 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98fbc5f937eb64cd364b3e1c3e4a55c8fce13cee8008771e7121f94ebdc3460e\": container with ID starting with 98fbc5f937eb64cd364b3e1c3e4a55c8fce13cee8008771e7121f94ebdc3460e not found: ID does not exist" containerID="98fbc5f937eb64cd364b3e1c3e4a55c8fce13cee8008771e7121f94ebdc3460e" Jul 21 19:00:13.039503 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.039452 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98fbc5f937eb64cd364b3e1c3e4a55c8fce13cee8008771e7121f94ebdc3460e"} err="failed to get container status \"98fbc5f937eb64cd364b3e1c3e4a55c8fce13cee8008771e7121f94ebdc3460e\": rpc error: code = NotFound desc = could not find container \"98fbc5f937eb64cd364b3e1c3e4a55c8fce13cee8008771e7121f94ebdc3460e\": container with ID starting with 98fbc5f937eb64cd364b3e1c3e4a55c8fce13cee8008771e7121f94ebdc3460e not found: ID does not exist" Jul 21 19:00:13.039503 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.039471 2556 scope.go:117] "RemoveContainer" containerID="cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3" Jul 21 19:00:13.046581 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.046564 2556 scope.go:117] "RemoveContainer" containerID="e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c" Jul 21 19:00:13.053504 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.053489 2556 scope.go:117] "RemoveContainer" containerID="cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4" Jul 21 19:00:13.060165 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.060150 2556 scope.go:117] "RemoveContainer" containerID="aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea" Jul 21 19:00:13.067242 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.067223 2556 scope.go:117] "RemoveContainer" containerID="4186c8a63838e5566b30df73d974b57f3cfcdd495c851ba78dc796fff0f224fa" Jul 21 19:00:13.073778 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.073763 2556 scope.go:117] "RemoveContainer" containerID="8aa2e4d186e3bbb2e2bf3ae410f00698abf775be4eb6319bd58a72846dc60a88" Jul 21 19:00:13.080357 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.080339 2556 scope.go:117] "RemoveContainer" containerID="cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3" Jul 21 19:00:13.080621 ip-10-0-136-34 kubenswrapper[2556]: E0721 19:00:13.080600 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3\": container with ID starting with cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3 not found: ID does not exist" containerID="cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3" Jul 21 19:00:13.080684 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.080629 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3"} err="failed to get container status \"cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3\": rpc error: code = NotFound desc = could not find container \"cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3\": container with ID starting with cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3 not found: ID does not exist" Jul 21 19:00:13.080684 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.080648 2556 scope.go:117] "RemoveContainer" containerID="e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c" Jul 21 19:00:13.080958 ip-10-0-136-34 kubenswrapper[2556]: E0721 19:00:13.080932 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c\": container with ID starting with e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c not found: ID does not exist" containerID="e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c" Jul 21 19:00:13.081030 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.080955 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c"} err="failed to get container status \"e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c\": rpc error: code = NotFound desc = could not find container \"e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c\": container with ID starting with e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c not found: ID does not exist" Jul 21 19:00:13.081030 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.080970 2556 scope.go:117] "RemoveContainer" containerID="cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4" Jul 21 19:00:13.081202 ip-10-0-136-34 kubenswrapper[2556]: E0721 19:00:13.081186 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4\": container with ID starting with cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4 not found: ID does not exist" containerID="cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4" Jul 21 19:00:13.081239 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.081208 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4"} err="failed to get container status \"cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4\": rpc error: code = NotFound desc = could not find container \"cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4\": container with ID starting with cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4 not found: ID does not exist" Jul 21 19:00:13.081239 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.081225 2556 scope.go:117] "RemoveContainer" containerID="aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea" Jul 21 19:00:13.081434 ip-10-0-136-34 kubenswrapper[2556]: E0721 19:00:13.081418 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea\": container with ID starting with aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea not found: ID does not exist" containerID="aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea" Jul 21 19:00:13.081480 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.081437 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea"} err="failed to get container status \"aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea\": rpc error: code = NotFound desc = could not find container \"aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea\": container with ID starting with aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea not found: ID does not exist" Jul 21 19:00:13.081480 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.081450 2556 scope.go:117] "RemoveContainer" containerID="4186c8a63838e5566b30df73d974b57f3cfcdd495c851ba78dc796fff0f224fa" Jul 21 19:00:13.081687 ip-10-0-136-34 kubenswrapper[2556]: E0721 19:00:13.081671 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4186c8a63838e5566b30df73d974b57f3cfcdd495c851ba78dc796fff0f224fa\": container with ID starting with 4186c8a63838e5566b30df73d974b57f3cfcdd495c851ba78dc796fff0f224fa not found: ID does not exist" containerID="4186c8a63838e5566b30df73d974b57f3cfcdd495c851ba78dc796fff0f224fa" Jul 21 19:00:13.081733 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.081689 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4186c8a63838e5566b30df73d974b57f3cfcdd495c851ba78dc796fff0f224fa"} err="failed to get container status \"4186c8a63838e5566b30df73d974b57f3cfcdd495c851ba78dc796fff0f224fa\": rpc error: code = NotFound desc = could not find container \"4186c8a63838e5566b30df73d974b57f3cfcdd495c851ba78dc796fff0f224fa\": container with ID starting with 4186c8a63838e5566b30df73d974b57f3cfcdd495c851ba78dc796fff0f224fa not found: ID does not exist" Jul 21 19:00:13.081733 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.081702 2556 scope.go:117] "RemoveContainer" containerID="8aa2e4d186e3bbb2e2bf3ae410f00698abf775be4eb6319bd58a72846dc60a88" Jul 21 19:00:13.081948 ip-10-0-136-34 kubenswrapper[2556]: E0721 19:00:13.081927 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aa2e4d186e3bbb2e2bf3ae410f00698abf775be4eb6319bd58a72846dc60a88\": container with ID starting with 8aa2e4d186e3bbb2e2bf3ae410f00698abf775be4eb6319bd58a72846dc60a88 not found: ID does not exist" containerID="8aa2e4d186e3bbb2e2bf3ae410f00698abf775be4eb6319bd58a72846dc60a88" Jul 21 19:00:13.081992 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.081953 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aa2e4d186e3bbb2e2bf3ae410f00698abf775be4eb6319bd58a72846dc60a88"} err="failed to get container status \"8aa2e4d186e3bbb2e2bf3ae410f00698abf775be4eb6319bd58a72846dc60a88\": rpc error: code = NotFound desc = could not find container \"8aa2e4d186e3bbb2e2bf3ae410f00698abf775be4eb6319bd58a72846dc60a88\": container with ID starting with 8aa2e4d186e3bbb2e2bf3ae410f00698abf775be4eb6319bd58a72846dc60a88 not found: ID does not exist" Jul 21 19:00:13.081992 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.081971 2556 scope.go:117] "RemoveContainer" containerID="cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3" Jul 21 19:00:13.082234 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.082208 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3"} err="failed to get container status \"cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3\": rpc error: code = NotFound desc = could not find container \"cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3\": container with ID starting with cfcd5b69fde975d03dae6c5aac5f53bbc9dd7844a288922662fbb0cc16a23ad3 not found: ID does not exist" Jul 21 19:00:13.082234 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.082232 2556 scope.go:117] "RemoveContainer" containerID="e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c" Jul 21 19:00:13.082472 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.082453 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c"} err="failed to get container status \"e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c\": rpc error: code = NotFound desc = could not find container \"e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c\": container with ID starting with e5986b49ed29fbfe4f78451a2baf7b783bab2628f3e94b637d633a562971734c not found: ID does not exist" Jul 21 19:00:13.082550 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.082474 2556 scope.go:117] "RemoveContainer" containerID="cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4" Jul 21 19:00:13.082706 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.082689 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4"} err="failed to get container status \"cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4\": rpc error: code = NotFound desc = could not find container \"cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4\": container with ID starting with cd55cce4e6258edf2700cda1de5b7ddca9f2e2b3953339ec89274f3c542fcbc4 not found: ID does not exist" Jul 21 19:00:13.082754 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.082708 2556 scope.go:117] "RemoveContainer" containerID="aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea" Jul 21 19:00:13.082928 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.082910 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea"} err="failed to get container status \"aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea\": rpc error: code = NotFound desc = could not find container \"aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea\": container with ID starting with aad5fc7557bacecaa32ee8ff66002e28ea7be9aed428c5771ed4e06ba7ead0ea not found: ID does not exist" Jul 21 19:00:13.083005 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.082928 2556 scope.go:117] "RemoveContainer" containerID="4186c8a63838e5566b30df73d974b57f3cfcdd495c851ba78dc796fff0f224fa" Jul 21 19:00:13.083167 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.083146 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4186c8a63838e5566b30df73d974b57f3cfcdd495c851ba78dc796fff0f224fa"} err="failed to get container status \"4186c8a63838e5566b30df73d974b57f3cfcdd495c851ba78dc796fff0f224fa\": rpc error: code = NotFound desc = could not find container \"4186c8a63838e5566b30df73d974b57f3cfcdd495c851ba78dc796fff0f224fa\": container with ID starting with 4186c8a63838e5566b30df73d974b57f3cfcdd495c851ba78dc796fff0f224fa not found: ID does not exist" Jul 21 19:00:13.083240 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.083169 2556 scope.go:117] "RemoveContainer" containerID="8aa2e4d186e3bbb2e2bf3ae410f00698abf775be4eb6319bd58a72846dc60a88" Jul 21 19:00:13.083375 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.083358 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aa2e4d186e3bbb2e2bf3ae410f00698abf775be4eb6319bd58a72846dc60a88"} err="failed to get container status \"8aa2e4d186e3bbb2e2bf3ae410f00698abf775be4eb6319bd58a72846dc60a88\": rpc error: code = NotFound desc = could not find container \"8aa2e4d186e3bbb2e2bf3ae410f00698abf775be4eb6319bd58a72846dc60a88\": container with ID starting with 8aa2e4d186e3bbb2e2bf3ae410f00698abf775be4eb6319bd58a72846dc60a88 not found: ID does not exist" Jul 21 19:00:13.115038 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.115008 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-registry-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 19:00:13.115038 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.115032 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-ui-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 19:00:13.115192 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.115062 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-online-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 19:00:13.115192 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.115070 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4744182d-ac0a-456d-9420-122d2ede8214-feast-data\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 19:00:13.115192 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.115079 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz9ts\" (UniqueName: \"kubernetes.io/projected/4744182d-ac0a-456d-9420-122d2ede8214-kube-api-access-dz9ts\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 19:00:13.115192 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.115096 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4744182d-ac0a-456d-9420-122d2ede8214-offline-tls\") on node \"ip-10-0-136-34.ec2.internal\" DevicePath \"\"" Jul 21 19:00:13.318471 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.318435 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7"] Jul 21 19:00:13.324713 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:13.324688 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-sjkz7"] Jul 21 19:00:14.980280 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:14.980248 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4744182d-ac0a-456d-9420-122d2ede8214" path="/var/lib/kubelet/pods/4744182d-ac0a-456d-9420-122d2ede8214/volumes" Jul 21 19:00:14.980890 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:14.980876 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" path="/var/lib/kubelet/pods/8b98655e-480b-4469-b5bd-f7e96fe8df07/volumes" Jul 21 19:00:50.349755 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.349725 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gbltb/must-gather-zjzjn"] Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350016 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="offline" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350028 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="offline" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350038 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="ui" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350043 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="ui" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350052 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="feast-init" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350059 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="feast-init" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350068 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="feast-apply" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350073 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="feast-apply" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350081 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="online" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350086 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="online" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350091 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="ui" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350096 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="ui" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350103 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="registry" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350108 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="registry" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350113 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="offline" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350118 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="offline" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350124 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="feast-apply" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350130 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="feast-apply" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350135 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="feast-init" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350139 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="feast-init" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350147 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="online" Jul 21 19:00:50.350184 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350176 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="online" Jul 21 19:00:50.350874 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350221 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="registry" Jul 21 19:00:50.350874 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350230 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="online" Jul 21 19:00:50.350874 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350235 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="ui" Jul 21 19:00:50.350874 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350241 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="offline" Jul 21 19:00:50.350874 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350248 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b98655e-480b-4469-b5bd-f7e96fe8df07" containerName="ui" Jul 21 19:00:50.350874 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350258 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="online" Jul 21 19:00:50.350874 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.350263 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4744182d-ac0a-456d-9420-122d2ede8214" containerName="offline" Jul 21 19:00:50.353278 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.353263 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbltb/must-gather-zjzjn" Jul 21 19:00:50.357365 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.357340 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gbltb\"/\"kube-root-ca.crt\"" Jul 21 19:00:50.357920 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.357903 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gbltb\"/\"openshift-service-ca.crt\"" Jul 21 19:00:50.357994 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.357908 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gbltb\"/\"default-dockercfg-mfx8k\"" Jul 21 19:00:50.367211 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.367182 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbltb/must-gather-zjzjn"] Jul 21 19:00:50.392927 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.392895 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w24rh\" (UniqueName: \"kubernetes.io/projected/8ed5d37f-494c-4fb5-946a-62c32e4f24c8-kube-api-access-w24rh\") pod \"must-gather-zjzjn\" (UID: \"8ed5d37f-494c-4fb5-946a-62c32e4f24c8\") " pod="openshift-must-gather-gbltb/must-gather-zjzjn" Jul 21 19:00:50.393100 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.392967 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8ed5d37f-494c-4fb5-946a-62c32e4f24c8-must-gather-output\") pod \"must-gather-zjzjn\" (UID: \"8ed5d37f-494c-4fb5-946a-62c32e4f24c8\") " pod="openshift-must-gather-gbltb/must-gather-zjzjn" Jul 21 19:00:50.493947 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.493909 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8ed5d37f-494c-4fb5-946a-62c32e4f24c8-must-gather-output\") pod \"must-gather-zjzjn\" (UID: \"8ed5d37f-494c-4fb5-946a-62c32e4f24c8\") " pod="openshift-must-gather-gbltb/must-gather-zjzjn" Jul 21 19:00:50.494151 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.493961 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w24rh\" (UniqueName: \"kubernetes.io/projected/8ed5d37f-494c-4fb5-946a-62c32e4f24c8-kube-api-access-w24rh\") pod \"must-gather-zjzjn\" (UID: \"8ed5d37f-494c-4fb5-946a-62c32e4f24c8\") " pod="openshift-must-gather-gbltb/must-gather-zjzjn" Jul 21 19:00:50.494343 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.494321 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8ed5d37f-494c-4fb5-946a-62c32e4f24c8-must-gather-output\") pod \"must-gather-zjzjn\" (UID: \"8ed5d37f-494c-4fb5-946a-62c32e4f24c8\") " pod="openshift-must-gather-gbltb/must-gather-zjzjn" Jul 21 19:00:50.503411 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.503380 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w24rh\" (UniqueName: \"kubernetes.io/projected/8ed5d37f-494c-4fb5-946a-62c32e4f24c8-kube-api-access-w24rh\") pod \"must-gather-zjzjn\" (UID: \"8ed5d37f-494c-4fb5-946a-62c32e4f24c8\") " pod="openshift-must-gather-gbltb/must-gather-zjzjn" Jul 21 19:00:50.682879 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.682780 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbltb/must-gather-zjzjn" Jul 21 19:00:50.813175 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.813015 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbltb/must-gather-zjzjn"] Jul 21 19:00:50.815913 ip-10-0-136-34 kubenswrapper[2556]: W0721 19:00:50.815886 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ed5d37f_494c_4fb5_946a_62c32e4f24c8.slice/crio-c75fb631e5ff6f9afaf6e79fc8d20bf4de9717d7ffdf0b6adbd5372e3daa9e58 WatchSource:0}: Error finding container c75fb631e5ff6f9afaf6e79fc8d20bf4de9717d7ffdf0b6adbd5372e3daa9e58: Status 404 returned error can't find the container with id c75fb631e5ff6f9afaf6e79fc8d20bf4de9717d7ffdf0b6adbd5372e3daa9e58 Jul 21 19:00:50.818111 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:50.818094 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 19:00:51.134701 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:51.134661 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbltb/must-gather-zjzjn" event={"ID":"8ed5d37f-494c-4fb5-946a-62c32e4f24c8","Type":"ContainerStarted","Data":"c75fb631e5ff6f9afaf6e79fc8d20bf4de9717d7ffdf0b6adbd5372e3daa9e58"} Jul 21 19:00:52.142819 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:52.142788 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbltb/must-gather-zjzjn" event={"ID":"8ed5d37f-494c-4fb5-946a-62c32e4f24c8","Type":"ContainerStarted","Data":"6b94ad3b55c715f1dd6ef3867ebe0ae422c57bb3292d036abd3b39d22577483c"} Jul 21 19:00:52.143228 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:52.142830 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbltb/must-gather-zjzjn" event={"ID":"8ed5d37f-494c-4fb5-946a-62c32e4f24c8","Type":"ContainerStarted","Data":"0b804ced75249f974ad855923464d68bc5eb57413ae332f5a611216a80330376"} Jul 21 19:00:52.161196 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:52.161146 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gbltb/must-gather-zjzjn" podStartSLOduration=1.289940151 podStartE2EDuration="2.161129878s" totalImagesPullingTime="871.189727ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:00:52.160996566 +0000 UTC m=+1815.223076175" watchObservedRunningTime="2026-07-21 19:00:52.161129878 +0000 UTC m=+1815.223209485" Jul 21 19:00:53.159524 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:53.159488 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-khz8z_7089390f-33ca-4e99-bb5c-0899bb33463d/global-pull-secret-syncer/0.log" Jul 21 19:00:53.241190 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:53.241147 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p9x2q_edd7de87-d5d3-4603-ab7c-66455f711e59/konnectivity-agent/0.log" Jul 21 19:00:53.317203 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:53.317165 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-34.ec2.internal_ab365cfc620fcb9efb235526502a3d4a/haproxy/0.log" Jul 21 19:00:57.306981 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.306900 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-597cf6959c-zhrhr_d334e0d5-185a-42fd-b391-88948ddd293c/metrics-server/0.log" Jul 21 19:00:57.336512 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.336433 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-5wpwk_2a4bf924-cc08-4f1b-8b34-28881d7cd679/monitoring-plugin/0.log" Jul 21 19:00:57.443779 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.443721 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-55zgr_84e00cf0-3628-4bac-9e53-69e4fec29d69/node-exporter/0.log" Jul 21 19:00:57.465775 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.465746 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-55zgr_84e00cf0-3628-4bac-9e53-69e4fec29d69/kube-rbac-proxy/0.log" Jul 21 19:00:57.484090 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.484060 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-55zgr_84e00cf0-3628-4bac-9e53-69e4fec29d69/init-textfile/0.log" Jul 21 19:00:57.590705 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.590675 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-bnngc_3637f426-8a31-4ceb-b13c-f14f26788359/kube-rbac-proxy-main/0.log" Jul 21 19:00:57.613413 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.613383 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-bnngc_3637f426-8a31-4ceb-b13c-f14f26788359/kube-rbac-proxy-self/0.log" Jul 21 19:00:57.633220 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.633186 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-bnngc_3637f426-8a31-4ceb-b13c-f14f26788359/openshift-state-metrics/0.log" Jul 21 19:00:57.668560 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.668530 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_77aa2839-3228-45e5-89b2-efaa645df588/prometheus/0.log" Jul 21 19:00:57.689818 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.689788 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_77aa2839-3228-45e5-89b2-efaa645df588/config-reloader/0.log" Jul 21 19:00:57.711318 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.711265 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_77aa2839-3228-45e5-89b2-efaa645df588/thanos-sidecar/0.log" Jul 21 19:00:57.732583 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.732548 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_77aa2839-3228-45e5-89b2-efaa645df588/kube-rbac-proxy-web/0.log" Jul 21 19:00:57.756014 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.755986 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_77aa2839-3228-45e5-89b2-efaa645df588/kube-rbac-proxy/0.log" Jul 21 19:00:57.778624 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.778585 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_77aa2839-3228-45e5-89b2-efaa645df588/kube-rbac-proxy-thanos/0.log" Jul 21 19:00:57.800911 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.800876 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_77aa2839-3228-45e5-89b2-efaa645df588/init-config-reloader/0.log" Jul 21 19:00:57.834313 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.834278 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-qqnjp_cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21/prometheus-operator/0.log" Jul 21 19:00:57.852049 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.851959 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-qqnjp_cd2efcd0-16c5-4fa2-8f80-aea4b4ab8c21/kube-rbac-proxy/0.log" Jul 21 19:00:57.984538 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:57.984503 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bc69b775-2s5jc_1cc854a5-5e90-4176-9be5-4b0f6ddc743d/thanos-query/0.log" Jul 21 19:00:58.008668 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:58.008642 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bc69b775-2s5jc_1cc854a5-5e90-4176-9be5-4b0f6ddc743d/kube-rbac-proxy-web/0.log" Jul 21 19:00:58.028522 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:58.028455 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bc69b775-2s5jc_1cc854a5-5e90-4176-9be5-4b0f6ddc743d/kube-rbac-proxy/0.log" Jul 21 19:00:58.048026 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:58.047936 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bc69b775-2s5jc_1cc854a5-5e90-4176-9be5-4b0f6ddc743d/prom-label-proxy/0.log" Jul 21 19:00:58.069125 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:58.069055 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bc69b775-2s5jc_1cc854a5-5e90-4176-9be5-4b0f6ddc743d/kube-rbac-proxy-rules/0.log" Jul 21 19:00:58.090252 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:00:58.090211 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bc69b775-2s5jc_1cc854a5-5e90-4176-9be5-4b0f6ddc743d/kube-rbac-proxy-metrics/0.log" Jul 21 19:01:00.140456 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.140428 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5fff764dd4-vmhff_bc1bb4a4-4969-418f-813e-19de4a9c93e6/console/0.log" Jul 21 19:01:00.493228 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.493123 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl"] Jul 21 19:01:00.499351 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.499327 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:00.506005 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.505969 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl"] Jul 21 19:01:00.593557 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.593523 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad187ea6-a4c1-4865-84e9-935acd26dac7-lib-modules\") pod \"perf-node-gather-daemonset-s8ptl\" (UID: \"ad187ea6-a4c1-4865-84e9-935acd26dac7\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:00.593716 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.593570 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjdnc\" (UniqueName: \"kubernetes.io/projected/ad187ea6-a4c1-4865-84e9-935acd26dac7-kube-api-access-jjdnc\") pod \"perf-node-gather-daemonset-s8ptl\" (UID: \"ad187ea6-a4c1-4865-84e9-935acd26dac7\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:00.593716 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.593670 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad187ea6-a4c1-4865-84e9-935acd26dac7-sys\") pod \"perf-node-gather-daemonset-s8ptl\" (UID: \"ad187ea6-a4c1-4865-84e9-935acd26dac7\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:00.593806 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.593719 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ad187ea6-a4c1-4865-84e9-935acd26dac7-podres\") pod \"perf-node-gather-daemonset-s8ptl\" (UID: \"ad187ea6-a4c1-4865-84e9-935acd26dac7\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:00.593806 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.593744 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ad187ea6-a4c1-4865-84e9-935acd26dac7-proc\") pod \"perf-node-gather-daemonset-s8ptl\" (UID: \"ad187ea6-a4c1-4865-84e9-935acd26dac7\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:00.694442 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.694404 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ad187ea6-a4c1-4865-84e9-935acd26dac7-podres\") pod \"perf-node-gather-daemonset-s8ptl\" (UID: \"ad187ea6-a4c1-4865-84e9-935acd26dac7\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:00.694937 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.694909 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ad187ea6-a4c1-4865-84e9-935acd26dac7-proc\") pod \"perf-node-gather-daemonset-s8ptl\" (UID: \"ad187ea6-a4c1-4865-84e9-935acd26dac7\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:00.695068 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.694833 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ad187ea6-a4c1-4865-84e9-935acd26dac7-podres\") pod \"perf-node-gather-daemonset-s8ptl\" (UID: \"ad187ea6-a4c1-4865-84e9-935acd26dac7\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:00.695068 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.695008 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ad187ea6-a4c1-4865-84e9-935acd26dac7-proc\") pod \"perf-node-gather-daemonset-s8ptl\" (UID: \"ad187ea6-a4c1-4865-84e9-935acd26dac7\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:00.695068 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.695036 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad187ea6-a4c1-4865-84e9-935acd26dac7-lib-modules\") pod \"perf-node-gather-daemonset-s8ptl\" (UID: \"ad187ea6-a4c1-4865-84e9-935acd26dac7\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:00.695194 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.695069 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjdnc\" (UniqueName: \"kubernetes.io/projected/ad187ea6-a4c1-4865-84e9-935acd26dac7-kube-api-access-jjdnc\") pod \"perf-node-gather-daemonset-s8ptl\" (UID: \"ad187ea6-a4c1-4865-84e9-935acd26dac7\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:00.695194 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.695126 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad187ea6-a4c1-4865-84e9-935acd26dac7-sys\") pod \"perf-node-gather-daemonset-s8ptl\" (UID: \"ad187ea6-a4c1-4865-84e9-935acd26dac7\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:00.695194 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.695170 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad187ea6-a4c1-4865-84e9-935acd26dac7-lib-modules\") pod \"perf-node-gather-daemonset-s8ptl\" (UID: \"ad187ea6-a4c1-4865-84e9-935acd26dac7\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:00.695304 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.695203 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad187ea6-a4c1-4865-84e9-935acd26dac7-sys\") pod \"perf-node-gather-daemonset-s8ptl\" (UID: \"ad187ea6-a4c1-4865-84e9-935acd26dac7\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:00.703615 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.703582 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjdnc\" (UniqueName: \"kubernetes.io/projected/ad187ea6-a4c1-4865-84e9-935acd26dac7-kube-api-access-jjdnc\") pod \"perf-node-gather-daemonset-s8ptl\" (UID: \"ad187ea6-a4c1-4865-84e9-935acd26dac7\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:00.815494 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.815199 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:00.980078 ip-10-0-136-34 kubenswrapper[2556]: W0721 19:01:00.980046 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podad187ea6_a4c1_4865_84e9_935acd26dac7.slice/crio-9ae187de8d887f462d0634f99fd4f9a616132667b4a274ab61cc631c646b491b WatchSource:0}: Error finding container 9ae187de8d887f462d0634f99fd4f9a616132667b4a274ab61cc631c646b491b: Status 404 returned error can't find the container with id 9ae187de8d887f462d0634f99fd4f9a616132667b4a274ab61cc631c646b491b Jul 21 19:01:00.983157 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:00.982948 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl"] Jul 21 19:01:01.189293 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:01.189254 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" event={"ID":"ad187ea6-a4c1-4865-84e9-935acd26dac7","Type":"ContainerStarted","Data":"5b9dcb259f634afd300030de6256892c89e580fb1e579e3017efb74c44313ee0"} Jul 21 19:01:01.189689 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:01.189321 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" event={"ID":"ad187ea6-a4c1-4865-84e9-935acd26dac7","Type":"ContainerStarted","Data":"9ae187de8d887f462d0634f99fd4f9a616132667b4a274ab61cc631c646b491b"} Jul 21 19:01:01.189689 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:01.189526 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:01.220828 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:01.219963 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" podStartSLOduration=1.219941385 podStartE2EDuration="1.219941385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:01:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:01:01.219588962 +0000 UTC m=+1824.281668572" watchObservedRunningTime="2026-07-21 19:01:01.219941385 +0000 UTC m=+1824.282020994" Jul 21 19:01:01.535466 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:01.535396 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k886l_ffe8c1b3-67b0-4726-8ae2-917e3077319c/dns/0.log" Jul 21 19:01:01.555319 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:01.555295 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k886l_ffe8c1b3-67b0-4726-8ae2-917e3077319c/kube-rbac-proxy/0.log" Jul 21 19:01:01.626513 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:01.626445 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-76v4f_4d7c7edc-9147-4594-b939-9223b6fc6e54/dns-node-resolver/0.log" Jul 21 19:01:02.130012 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:02.129984 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-272qz_099eff05-04f7-4d97-9f16-47403e49f308/node-ca/0.log" Jul 21 19:01:03.263977 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:03.263944 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fmq2l_a2266407-4301-41ee-847b-7b648be92c94/serve-healthcheck-canary/0.log" Jul 21 19:01:03.691533 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:03.691507 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8l9zb_4516a5a2-5ec8-4665-8c5c-77a4d809dcfb/kube-rbac-proxy/0.log" Jul 21 19:01:03.719162 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:03.719132 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8l9zb_4516a5a2-5ec8-4665-8c5c-77a4d809dcfb/exporter/0.log" Jul 21 19:01:03.744780 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:03.744750 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8l9zb_4516a5a2-5ec8-4665-8c5c-77a4d809dcfb/extractor/0.log" Jul 21 19:01:07.205392 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:07.205363 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-s8ptl" Jul 21 19:01:09.701682 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:09.701595 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mm58k_19b651b5-3d20-413a-9bdc-695c0223b53b/kube-multus-additional-cni-plugins/0.log" Jul 21 19:01:09.731162 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:09.731131 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mm58k_19b651b5-3d20-413a-9bdc-695c0223b53b/egress-router-binary-copy/0.log" Jul 21 19:01:09.752468 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:09.752418 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mm58k_19b651b5-3d20-413a-9bdc-695c0223b53b/cni-plugins/0.log" Jul 21 19:01:09.782553 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:09.782527 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mm58k_19b651b5-3d20-413a-9bdc-695c0223b53b/bond-cni-plugin/0.log" Jul 21 19:01:09.804881 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:09.804841 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mm58k_19b651b5-3d20-413a-9bdc-695c0223b53b/routeoverride-cni/0.log" Jul 21 19:01:09.829620 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:09.829592 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mm58k_19b651b5-3d20-413a-9bdc-695c0223b53b/whereabouts-cni-bincopy/0.log" Jul 21 19:01:09.862452 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:09.862409 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mm58k_19b651b5-3d20-413a-9bdc-695c0223b53b/whereabouts-cni/0.log" Jul 21 19:01:10.079908 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:10.079878 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-d8kt6_edef5c78-4c08-484b-aec7-d3a3ed263aa7/kube-multus/0.log" Jul 21 19:01:10.133186 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:10.133149 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-649bh_a470140f-489b-4888-b8a9-3602acdd8640/network-metrics-daemon/0.log" Jul 21 19:01:10.154355 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:10.154328 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-649bh_a470140f-489b-4888-b8a9-3602acdd8640/kube-rbac-proxy/0.log" Jul 21 19:01:11.073564 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:11.073535 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-49tds_f54565df-771f-43bc-bc59-4b9eb71143e0/ovn-controller/0.log" Jul 21 19:01:11.091232 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:11.091205 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-49tds_f54565df-771f-43bc-bc59-4b9eb71143e0/ovn-acl-logging/0.log" Jul 21 19:01:11.114468 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:11.114440 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-49tds_f54565df-771f-43bc-bc59-4b9eb71143e0/kube-rbac-proxy-node/0.log" Jul 21 19:01:11.133837 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:11.133808 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-49tds_f54565df-771f-43bc-bc59-4b9eb71143e0/kube-rbac-proxy-ovn-metrics/0.log" Jul 21 19:01:11.153424 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:11.153396 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-49tds_f54565df-771f-43bc-bc59-4b9eb71143e0/northd/0.log" Jul 21 19:01:11.174456 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:11.174430 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-49tds_f54565df-771f-43bc-bc59-4b9eb71143e0/nbdb/0.log" Jul 21 19:01:11.193712 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:11.193688 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-49tds_f54565df-771f-43bc-bc59-4b9eb71143e0/sbdb/0.log" Jul 21 19:01:11.242182 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:11.242150 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-49tds_f54565df-771f-43bc-bc59-4b9eb71143e0/ovnkube-controller/0.log" Jul 21 19:01:12.568918 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:12.568889 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-d9kjr_287e892d-0539-4cd6-91c9-13035bd0f542/network-check-target-container/0.log" Jul 21 19:01:13.513224 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:13.513193 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-q2q92_8758962d-fe0b-44ba-b914-8df03e5a733b/iptables-alerter/0.log" Jul 21 19:01:14.125467 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:14.125421 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-kql8l_e6b1218e-fe6e-494c-ad23-41a05dd07b75/tuned/0.log" Jul 21 19:01:17.155898 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:17.155870 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-bkzrq_5c60db40-aa63-4bc3-8889-81225f113c8a/csi-driver/0.log" Jul 21 19:01:17.174786 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:17.174732 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-bkzrq_5c60db40-aa63-4bc3-8889-81225f113c8a/csi-node-driver-registrar/0.log" Jul 21 19:01:17.193402 ip-10-0-136-34 kubenswrapper[2556]: I0721 19:01:17.193375 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-bkzrq_5c60db40-aa63-4bc3-8889-81225f113c8a/csi-liveness-probe/0.log"