Jul 06 20:46:55.202639 ip-10-0-142-58 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 20:46:55.202652 ip-10-0-142-58 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 20:46:55.202662 ip-10-0-142-58 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 20:46:55.203042 ip-10-0-142-58 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 20:47:05.367132 ip-10-0-142-58 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 20:47:05.367152 ip-10-0-142-58 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3f46f2484dd849caa5a143ef5a9d2036 -- Jul 06 20:48:38.528400 ip-10-0-142-58 systemd[1]: Starting Kubernetes Kubelet... Jul 06 20:48:39.008776 ip-10-0-142-58 kubenswrapper[2586]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:48:39.008776 ip-10-0-142-58 kubenswrapper[2586]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 20:48:39.008776 ip-10-0-142-58 kubenswrapper[2586]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:48:39.008776 ip-10-0-142-58 kubenswrapper[2586]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 20:48:39.008776 ip-10-0-142-58 kubenswrapper[2586]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:48:39.008776 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.000650 2586 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 20:48:39.008776 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005669 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:48:39.008776 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005684 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:48:39.008776 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005687 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:48:39.008776 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005693 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:48:39.008776 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005696 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:48:39.008776 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005699 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:48:39.008776 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005701 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:48:39.008776 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005705 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005707 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005710 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005713 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005715 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005719 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005724 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005728 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005732 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005745 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005762 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005765 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005768 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005771 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005774 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005776 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005779 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005782 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005785 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:48:39.015208 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005790 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005794 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005797 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005801 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005804 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005807 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005810 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005812 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005815 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005817 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005820 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005823 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005825 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005829 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005832 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005834 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005837 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005845 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005850 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005853 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:48:39.016901 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005856 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005859 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005861 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005865 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005868 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005871 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005873 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005876 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005878 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005881 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005884 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005886 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005889 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005891 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005894 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005897 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005901 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005905 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005908 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005910 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:48:39.019181 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005913 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005916 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005919 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005922 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005924 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005927 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005929 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005932 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005936 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005940 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005943 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005946 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005949 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005951 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005954 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005958 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005962 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005965 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005967 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:48:39.202663 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005970 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005973 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005976 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005979 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005981 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005984 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005986 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005989 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005992 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005994 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005997 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.005999 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006002 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006004 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006783 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006792 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006796 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006799 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006802 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:48:39.222730 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006805 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:48:39.087709 ip-10-0-142-58 systemd[1]: Started Kubernetes Kubelet. Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006808 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006811 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006813 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006816 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006819 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006822 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006825 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006828 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006832 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006836 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006838 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006841 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006844 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006847 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006850 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006853 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006855 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006858 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:48:39.224408 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006861 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006863 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006866 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006868 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006871 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006874 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006876 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006879 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006882 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006884 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006889 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006892 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006894 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006896 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006899 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006901 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006904 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006907 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006909 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006912 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:48:39.226179 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006915 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006920 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006923 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006926 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006931 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006935 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006938 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006941 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006943 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006946 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006948 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006951 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006954 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006956 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006959 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006962 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006964 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006967 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006970 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006972 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:48:39.227602 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006975 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006977 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006981 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006983 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006986 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006989 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006991 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006995 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.006998 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007001 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007004 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007007 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007009 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007012 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007015 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007017 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007020 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007022 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007025 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:48:39.229895 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007027 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007029 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007032 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007034 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007037 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007039 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007042 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007044 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007047 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007049 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007051 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007055 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007058 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007061 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007064 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007068 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007610 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007619 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007624 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:48:39.231830 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007631 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007636 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007641 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007646 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007650 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007654 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007658 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007664 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007668 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007672 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007677 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007682 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007686 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007689 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007693 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007697 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007701 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007705 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007709 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:48:39.233726 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007712 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007716 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007720 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007725 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007728 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007732 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007736 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007739 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007744 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007750 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007753 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007757 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007760 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007763 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007767 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007771 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007774 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007778 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007781 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:48:39.253652 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007784 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007788 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007791 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007795 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007798 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007801 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007805 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007809 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007812 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007815 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007818 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007821 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007824 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007828 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007831 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007834 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007837 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007840 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007843 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007846 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:48:39.254667 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007850 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007853 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007858 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007861 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007864 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007869 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007872 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007876 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007879 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007884 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007888 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007892 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007895 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007899 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007902 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007906 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007911 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007914 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007917 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007920 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:48:39.255580 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007923 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007927 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007930 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007933 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007936 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007939 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007943 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007946 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007949 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007952 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007955 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007958 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007962 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007966 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007971 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007974 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007978 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.007981 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.008257 2586 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.008268 2586 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.008275 2586 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 20:48:39.256708 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.008280 2586 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.008291 2586 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.008295 2586 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.008300 2586 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.008305 2586 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.008320 2586 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.008324 2586 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.008330 2586 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.008333 2586 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.008340 2586 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.008343 2586 flags.go:64] FLAG: --cgroup-root="" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009559 2586 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009568 2586 flags.go:64] FLAG: --client-ca-file="" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009574 2586 flags.go:64] FLAG: --cloud-provider="external" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009580 2586 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009590 2586 flags.go:64] FLAG: --cluster-domain="" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009596 2586 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009602 2586 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009659 2586 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009786 2586 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009801 2586 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009805 2586 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009809 2586 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 20:48:39.257804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009813 2586 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009816 2586 flags.go:64] FLAG: --contention-profiling="false" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009820 2586 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009823 2586 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009827 2586 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009830 2586 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009835 2586 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009838 2586 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009850 2586 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009854 2586 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009858 2586 flags.go:64] FLAG: --enable-server="true" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009861 2586 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009868 2586 flags.go:64] FLAG: --event-burst="100" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009871 2586 flags.go:64] FLAG: --event-qps="50" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009874 2586 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009877 2586 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009881 2586 flags.go:64] FLAG: --eviction-hard="" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009885 2586 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009888 2586 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009891 2586 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009894 2586 flags.go:64] FLAG: --eviction-soft="" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009896 2586 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009899 2586 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009902 2586 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009905 2586 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 20:48:39.258919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009908 2586 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009911 2586 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009914 2586 flags.go:64] FLAG: --feature-gates="" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009919 2586 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009922 2586 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009925 2586 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009928 2586 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009932 2586 flags.go:64] FLAG: --healthz-port="10248" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009935 2586 flags.go:64] FLAG: --help="false" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009938 2586 flags.go:64] FLAG: --hostname-override="ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009942 2586 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009945 2586 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009948 2586 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009952 2586 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009957 2586 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009960 2586 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009963 2586 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009966 2586 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009969 2586 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009972 2586 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009975 2586 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009978 2586 flags.go:64] FLAG: --kube-reserved="" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009981 2586 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009984 2586 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 20:48:39.260383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009988 2586 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009991 2586 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009994 2586 flags.go:64] FLAG: --lock-file="" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009996 2586 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.009999 2586 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010002 2586 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010008 2586 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010011 2586 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010014 2586 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010017 2586 flags.go:64] FLAG: --logging-format="text" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010020 2586 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010026 2586 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010029 2586 flags.go:64] FLAG: --manifest-url="" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010032 2586 flags.go:64] FLAG: --manifest-url-header="" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010037 2586 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010040 2586 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010045 2586 flags.go:64] FLAG: --max-pods="110" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010048 2586 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010052 2586 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010054 2586 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010057 2586 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010061 2586 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010064 2586 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010068 2586 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010116 2586 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 20:48:39.261476 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010123 2586 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010127 2586 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010130 2586 flags.go:64] FLAG: --pod-cidr="" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010133 2586 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010139 2586 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010142 2586 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010146 2586 flags.go:64] FLAG: --pods-per-core="0" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010150 2586 flags.go:64] FLAG: --port="10250" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010153 2586 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010157 2586 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-026e51a7a9e29a922" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010160 2586 flags.go:64] FLAG: --qos-reserved="" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010164 2586 flags.go:64] FLAG: --read-only-port="10255" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010167 2586 flags.go:64] FLAG: --register-node="true" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010170 2586 flags.go:64] FLAG: --register-with-taints="" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010175 2586 flags.go:64] FLAG: --registry-burst="10" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010179 2586 flags.go:64] FLAG: --registry-qps="5" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010182 2586 flags.go:64] FLAG: --reserved-cpus="" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010185 2586 flags.go:64] FLAG: --reserved-memory="" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010188 2586 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010191 2586 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010194 2586 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010197 2586 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010200 2586 flags.go:64] FLAG: --runonce="false" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010203 2586 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010207 2586 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 20:48:39.262580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010210 2586 flags.go:64] FLAG: --seccomp-default="false" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010213 2586 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010216 2586 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010220 2586 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010223 2586 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010227 2586 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010230 2586 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010233 2586 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010236 2586 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010239 2586 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010243 2586 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010246 2586 flags.go:64] FLAG: --system-cgroups="" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010249 2586 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010256 2586 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010259 2586 flags.go:64] FLAG: --tls-cert-file="" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010262 2586 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010275 2586 flags.go:64] FLAG: --tls-min-version="" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010278 2586 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010281 2586 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010284 2586 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010287 2586 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010290 2586 flags.go:64] FLAG: --v="2" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010298 2586 flags.go:64] FLAG: --version="false" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010302 2586 flags.go:64] FLAG: --vmodule="" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010306 2586 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 20:48:39.263737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.010310 2586 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010430 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010434 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010437 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010441 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010444 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010447 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010449 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010452 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010455 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010458 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010460 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010463 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010466 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010469 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010471 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010474 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010477 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010480 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010486 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:48:39.264856 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010489 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010491 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010494 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010496 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010499 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010501 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010505 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010507 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010510 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010512 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010515 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010518 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010522 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010524 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010527 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010529 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010533 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010536 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010538 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010541 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:48:39.265733 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010544 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010546 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010549 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010551 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010556 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010559 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010562 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010566 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010569 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010572 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010575 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010579 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010581 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010584 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010587 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010590 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010592 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010595 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010598 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:48:39.266623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010600 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010604 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010608 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010611 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010614 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010617 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010620 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010623 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010625 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010630 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010632 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010635 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010638 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010640 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010643 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010645 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010648 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010651 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010653 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010656 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:48:39.267511 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010658 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010661 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010663 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010666 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010670 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010673 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010675 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010678 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010680 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010683 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010685 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010688 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010690 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010693 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010696 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010698 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010701 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010704 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010706 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010710 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:48:39.270305 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.010713 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:48:39.271192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.012017 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:48:39.271192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.026024 2586 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 20:48:39.271192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.026041 2586 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 20:48:39.271192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.026062 2586 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 20:48:39.271192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.026069 2586 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 20:48:39.271192 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026146 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:48:39.271192 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026152 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:48:39.271192 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026156 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:48:39.271192 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026159 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:48:39.271192 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026162 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:48:39.271192 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026165 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:48:39.271192 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026168 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:48:39.271192 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026171 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:48:39.271192 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026173 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:48:39.271192 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026176 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026179 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026181 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026184 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026187 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026190 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026193 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026196 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026198 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026201 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026204 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026207 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026210 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026213 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026216 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026218 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026221 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026223 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026226 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026228 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:48:39.272496 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026232 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026235 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026237 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026240 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026242 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026245 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026248 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026250 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026253 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026255 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026258 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026261 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026264 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026267 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026272 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026274 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026276 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026280 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026284 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:48:39.273414 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026287 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026290 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026294 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026297 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026300 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026303 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026305 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026308 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026310 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026313 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026316 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026318 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026321 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026323 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026326 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026329 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026332 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026334 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026337 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026339 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026342 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:48:39.274522 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026345 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026347 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026351 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026355 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026357 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026360 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026363 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026365 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026368 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026370 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026373 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026375 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026378 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026380 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026383 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026386 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026389 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026391 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026394 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:48:39.275427 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026396 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:48:39.392298 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026399 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:48:39.392298 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026402 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:48:39.392298 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026404 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:48:39.392298 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026407 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:48:39.392298 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026410 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:48:39.392298 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026413 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:48:39.392298 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026415 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:48:39.392298 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026418 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:48:39.392298 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026421 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:48:39.392298 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026423 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:48:39.392298 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.026428 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:48:39.392298 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026550 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:48:39.392298 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026555 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:48:39.392298 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026558 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:48:39.392298 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026561 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026564 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026567 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026570 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026572 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026575 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026578 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026580 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026583 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026585 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026588 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026593 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026595 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026598 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026601 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026604 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026608 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026610 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026613 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:48:39.393387 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026616 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026619 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026622 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026624 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026627 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026630 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026633 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026636 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026639 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026641 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026643 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026646 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026648 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026651 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026653 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026655 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026658 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026660 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026663 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026665 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:48:39.394890 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026668 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026670 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026672 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026675 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026677 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026682 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026685 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026688 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026691 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026695 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026698 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026700 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026703 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026706 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026708 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026711 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026714 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026716 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026719 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026721 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:48:39.395799 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026724 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026726 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026729 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026731 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026734 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026736 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026739 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026741 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026744 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026746 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026749 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026751 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026753 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026756 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026758 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026761 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026763 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026767 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026770 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:48:39.396875 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026772 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:48:39.401378 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026775 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:48:39.401378 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026778 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:48:39.401378 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026780 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:48:39.401378 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026783 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:48:39.401378 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026785 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:48:39.401378 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026788 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:48:39.401378 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026790 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:48:39.401378 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026793 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:48:39.401378 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026795 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:48:39.401378 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026798 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:48:39.401378 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026801 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:48:39.401378 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026803 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:48:39.401378 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026807 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:48:39.401378 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026809 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:48:39.401378 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026812 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:48:39.401378 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026814 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:48:39.401378 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:39.026816 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:48:39.402242 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.026821 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:48:39.402242 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.026955 2586 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 20:48:39.402242 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.029454 2586 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 20:48:39.402242 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.031250 2586 server.go:1019] "Starting client certificate rotation" Jul 06 20:48:39.402242 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.031350 2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:48:39.402242 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.032262 2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:48:39.402242 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.034172 2586 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:48:39.402242 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.038426 2586 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:48:39.402242 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.049645 2586 log.go:25] "Validated CRI v1 runtime API" Jul 06 20:48:39.402242 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.053377 2586 log.go:25] "Validated CRI v1 image API" Jul 06 20:48:39.402242 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.055311 2586 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 20:48:39.402242 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.058548 2586 fs.go:135] Filesystem UUIDs: map[79179cc7-d689-45a5-9cd9-47363b8cf84e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b41de992-4138-4c22-8982-2425b6670197:/dev/nvme0n1p4] Jul 06 20:48:39.402888 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.058566 2586 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 20:48:39.403746 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.063758 2586 manager.go:216] Machine: {Timestamp:2026-07-06 20:48:39.063271622 +0000 UTC m=+0.397088124 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100113 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25b3fd50587d2e5be36a81a372684a SystemUUID:ec25b3fd-5058-7d2e-5be3-6a81a372684a BootID:3f46f248-4dd8-49ca-a5a1-43ef5a9d2036 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:07:2e:b5:2e:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:07:2e:b5:2e:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:e4:26:f4:b1:7e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 20:48:39.403746 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.063860 2586 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 20:48:39.403746 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.063940 2586 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 20:48:39.403746 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.066582 2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:48:39.403746 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.067705 2586 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 20:48:39.403746 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.067741 2586 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-58.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 20:48:39.403746 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.068609 2586 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.068619 2586 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.068627 2586 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.069461 2586 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.071314 2586 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.076011 2586 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.076160 2586 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.076197 2586 kubelet.go:486] "Attempting to sync node with API server" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.076207 2586 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.076222 2586 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.076232 2586 kubelet.go:398] "Adding apiserver pod source" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.076240 2586 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.076713 2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.076731 2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.079250 2586 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.081735 2586 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.081763 2586 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.083181 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.083202 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.083211 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.083219 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.083228 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.083247 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.083255 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.083260 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.083266 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.083271 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.083279 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.083285 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.083309 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.083315 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.086828 2586 server.go:1268] "Started kubelet" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.086943 2586 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.087131 2586 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.087302 2586 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.090429 2586 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.090428 2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-58.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.090508 2586 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-58.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.090836 2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.092822 2586 server.go:310] "Adding debug handlers to kubelet server" Jul 06 20:48:39.404195 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.094520 2586 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.095928 2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-58.ec2.internal.18bfce66f6e9a344 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-58.ec2.internal,UID:ip-10-0-142-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-58.ec2.internal,},FirstTimestamp:2026-07-06 20:48:39.086498628 +0000 UTC m=+0.420315131,LastTimestamp:2026-07-06 20:48:39.086498628 +0000 UTC m=+0.420315131,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-58.ec2.internal,}" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.105403 2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.106003 2586 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.106109 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.106806 2586 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.106834 2586 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.106851 2586 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.106940 2586 reconstruct.go:97] "Volume reconstruction finished" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.106950 2586 reconciler.go:29] "Reconciler: start to sync state" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.107032 2586 factory.go:55] Registering systemd factory Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.107049 2586 factory.go:223] Registration of the systemd container factory successfully Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.107290 2586 factory.go:153] Registering CRI-O factory Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.107303 2586 factory.go:223] Registration of the crio container factory successfully Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.107343 2586 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.107364 2586 factory.go:103] Registering Raw factory Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.107379 2586 manager.go:1196] Started watching for new ooms in manager Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.107852 2586 manager.go:349] Starting recovery of all containers Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.113320 2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hfctz" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.116897 2586 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.117048 2586 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-58.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.119386 2586 manager.go:354] Recovery completed Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.122147 2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hfctz" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.124277 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.126470 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.126505 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.126529 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.127243 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.127250 2586 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.127262 2586 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.127284 2586 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.128355 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:48:39.406383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.128386 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.128400 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.129384 2586 policy_none.go:49] "None policy: Start" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.129397 2586 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.129418 2586 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.131488 2586 policy_none.go:47] "Start" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.205694 2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.206157 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.206945 2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.206982 2586 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.207007 2586 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.207039 2586 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.209536 2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.254799 2586 manager.go:337] "Starting Device Plugin manager" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.254905 2586 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.254919 2586 server.go:87] "Starting device plugin registration server" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.255301 2586 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.255315 2586 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.255839 2586 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.256119 2586 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.256128 2586 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.256496 2586 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.256538 2586 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-58.ec2.internal\" not found" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.311555 2586 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal"] Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.311636 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.320890 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.320918 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.320928 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.323115 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.323158 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.323189 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.323918 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.323942 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.323952 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.324373 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.324395 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.324413 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.325885 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.408747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.325909 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:48:39.410279 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.326577 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:48:39.410279 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.326599 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:48:39.410279 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.326609 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:48:39.410279 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.327352 2586 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-58.ec2.internal\" not found" node="ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.410279 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.355577 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:48:39.410279 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.356447 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:48:39.410279 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.356475 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:48:39.410279 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.356485 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:48:39.410279 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.356516 2586 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.410279 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.360992 2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-58.ec2.internal\" not found" node="ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.410279 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.364985 2586 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.410279 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.365003 2586 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-58.ec2.internal\": node \"ip-10-0-142-58.ec2.internal\" not found" Jul 06 20:48:39.410279 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.365617 2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-58.ec2.internal\" not found" node="ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.410279 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.393776 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" Jul 06 20:48:39.413520 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.412296 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa129323fd96e838d69ffbe2645f9ba4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal\" (UID: \"aa129323fd96e838d69ffbe2645f9ba4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.413520 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.412326 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93c5fe6b20d1f802096a59c4920e1e2c-config\") pod \"kube-apiserver-proxy-ip-10-0-142-58.ec2.internal\" (UID: \"93c5fe6b20d1f802096a59c4920e1e2c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.413520 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.412346 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa129323fd96e838d69ffbe2645f9ba4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal\" (UID: \"aa129323fd96e838d69ffbe2645f9ba4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.539580 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.494463 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" Jul 06 20:48:39.539580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.512924 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa129323fd96e838d69ffbe2645f9ba4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal\" (UID: \"aa129323fd96e838d69ffbe2645f9ba4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.539580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.512949 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa129323fd96e838d69ffbe2645f9ba4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal\" (UID: \"aa129323fd96e838d69ffbe2645f9ba4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.539580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.512969 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93c5fe6b20d1f802096a59c4920e1e2c-config\") pod \"kube-apiserver-proxy-ip-10-0-142-58.ec2.internal\" (UID: \"93c5fe6b20d1f802096a59c4920e1e2c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.539580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.513010 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93c5fe6b20d1f802096a59c4920e1e2c-config\") pod \"kube-apiserver-proxy-ip-10-0-142-58.ec2.internal\" (UID: \"93c5fe6b20d1f802096a59c4920e1e2c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.539580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.513036 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa129323fd96e838d69ffbe2645f9ba4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal\" (UID: \"aa129323fd96e838d69ffbe2645f9ba4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.539580 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.513052 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa129323fd96e838d69ffbe2645f9ba4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal\" (UID: \"aa129323fd96e838d69ffbe2645f9ba4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.687688 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.595037 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" Jul 06 20:48:39.687688 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.664712 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.687688 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.668583 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" Jul 06 20:48:39.695920 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.695589 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" Jul 06 20:48:39.812257 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.799039 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" Jul 06 20:48:39.946510 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:39.901262 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" Jul 06 20:48:40.100597 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:39.970687 2586 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:48:40.100597 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:40.001822 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" Jul 06 20:48:40.100597 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:40.030385 2586 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 20:48:40.100597 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:40.030556 2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 20:48:40.100597 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:40.030574 2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 20:48:40.103904 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:40.102260 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" Jul 06 20:48:40.213849 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:40.125461 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 20:43:39 +0000 UTC" deadline="2028-04-11 14:19:26.212317212 +0000 UTC" Jul 06 20:48:40.213849 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:40.125489 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15473h30m46.086831935s" Jul 06 20:48:40.213849 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:40.202799 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" Jul 06 20:48:40.341203 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:40.275689 2586 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:48:40.341203 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:40.306604 2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" Jul 06 20:48:40.341203 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:40.322393 2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:48:40.341203 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:40.323868 2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" Jul 06 20:48:40.341203 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:40.332300 2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:48:40.436463 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:40.392716 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa129323fd96e838d69ffbe2645f9ba4.slice/crio-e7bf36cfe3245939df2c9af077219a6518f673ee90f6fd0876f909d64d67ed99 WatchSource:0}: Error finding container e7bf36cfe3245939df2c9af077219a6518f673ee90f6fd0876f909d64d67ed99: Status 404 returned error can't find the container with id e7bf36cfe3245939df2c9af077219a6518f673ee90f6fd0876f909d64d67ed99 Jul 06 20:48:40.436463 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:40.409166 2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:48:40.436463 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:40.423322 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c5fe6b20d1f802096a59c4920e1e2c.slice/crio-fded0b72b6c1318bc273313b46257d6277b9d4c67ea92a607153d95336fecc4f WatchSource:0}: Error finding container fded0b72b6c1318bc273313b46257d6277b9d4c67ea92a607153d95336fecc4f: Status 404 returned error can't find the container with id fded0b72b6c1318bc273313b46257d6277b9d4c67ea92a607153d95336fecc4f Jul 06 20:48:40.451676 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:40.450481 2586 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:48:41.077466 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.077428 2586 apiserver.go:52] "Watching apiserver" Jul 06 20:48:41.087307 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.087272 2586 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 20:48:41.087831 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.087806 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-rp2sj","kube-system/global-pull-secret-syncer-s4cpg","kube-system/konnectivity-agent-qvt6g","openshift-cluster-node-tuning-operator/tuned-9lg84","openshift-multus/multus-additional-cni-plugins-nwzh6","openshift-network-operator/iptables-alerter-7wdzt","openshift-ovn-kubernetes/ovnkube-node-gl8x4","kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv","openshift-dns/node-resolver-pzt4k","openshift-image-registry/node-ca-2d92l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal","openshift-multus/multus-rkktm","openshift-multus/network-metrics-daemon-f7qm4"] Jul 06 20:48:41.091072 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.090741 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.094291 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.094262 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.095294 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.095086 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 20:48:41.095294 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.095191 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 20:48:41.095294 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.095086 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 20:48:41.096871 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.096029 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 20:48:41.096871 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.096269 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 20:48:41.096871 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.096367 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w4tvw\"" Jul 06 20:48:41.096871 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.096547 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qvt6g" Jul 06 20:48:41.096871 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.096675 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 20:48:41.100295 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.098546 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.100295 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.099206 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 20:48:41.101917 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.101172 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 20:48:41.101917 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.101201 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 20:48:41.101917 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.101276 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:48:41.101917 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.101398 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 20:48:41.101917 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.101496 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6ctj9\"" Jul 06 20:48:41.101917 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.101545 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 20:48:41.101917 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.101554 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 20:48:41.101917 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.101585 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.101917 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.101710 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8ljrd\"" Jul 06 20:48:41.102889 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.102304 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 20:48:41.102889 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.102458 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9x7sw\"" Jul 06 20:48:41.104719 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.104242 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:41.104719 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.104325 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:48:41.104719 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.104543 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dhhqt\"" Jul 06 20:48:41.104719 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.104651 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 20:48:41.105461 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.105443 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 20:48:41.106561 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.106540 2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 20:48:41.106924 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.106906 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.109980 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.109923 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 20:48:41.110101 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.110008 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jfr4g\"" Jul 06 20:48:41.110556 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.109925 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 20:48:41.110658 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.110626 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 20:48:41.112180 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.110819 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:48:41.112180 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.110994 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:48:41.115281 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.113719 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2d92l" Jul 06 20:48:41.116747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.116724 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 20:48:41.116861 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.116848 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 20:48:41.116987 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.116724 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n6t7j\"" Jul 06 20:48:41.117068 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.116988 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 20:48:41.117945 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.117926 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pzt4k" Jul 06 20:48:41.120565 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.120532 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 20:48:41.122054 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.121157 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:41.122054 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.121245 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:48:41.122054 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.120888 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 20:48:41.122054 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.121729 2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:48:41.122054 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.120828 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6c6z2\"" Jul 06 20:48:41.122674 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.122654 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-lib-modules\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.122894 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.122877 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-var-lib-openvswitch\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.123041 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.123023 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-ovnkube-script-lib\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.123198 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.123181 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frmbb\" (UniqueName: \"kubernetes.io/projected/305a40cd-a1ac-4b06-aa5f-c09c29459213-kube-api-access-frmbb\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.123334 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.123319 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcgx5\" (UniqueName: \"kubernetes.io/projected/014fb632-7183-4ad8-a74e-838a8d162eef-kube-api-access-qcgx5\") pod \"network-metrics-daemon-f7qm4\" (UID: \"014fb632-7183-4ad8-a74e-838a8d162eef\") " pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:41.123509 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.123493 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdcnk\" (UniqueName: \"kubernetes.io/projected/15d6af7f-a295-4b83-8a7e-71280841ca8a-kube-api-access-qdcnk\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.123763 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.123722 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d418585-bb7c-41bd-ac8f-56bfaf494254-agent-certs\") pod \"konnectivity-agent-qvt6g\" (UID: \"1d418585-bb7c-41bd-ac8f-56bfaf494254\") " pod="kube-system/konnectivity-agent-qvt6g" Jul 06 20:48:41.124072 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.124055 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-var-lib-kubelet\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.124454 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.124433 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htc5b\" (UniqueName: \"kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b\") pod \"network-check-target-rp2sj\" (UID: \"a2ec5721-43da-420a-979e-8d87ce647c73\") " pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:48:41.124650 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.124635 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-run-ovn-kubernetes\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.126051 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.123683 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7wdzt" Jul 06 20:48:41.126792 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.126772 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-kubelet\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.126964 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.126948 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-log-socket\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.127575 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.127527 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.129622 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.128169 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 20:48:41.129622 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129308 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/305a40cd-a1ac-4b06-aa5f-c09c29459213-os-release\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.129622 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129361 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/305a40cd-a1ac-4b06-aa5f-c09c29459213-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.129622 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129404 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-multus-socket-dir-parent\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.129622 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129443 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-sysconfig\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.129622 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129468 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3cec350-f1a4-47f6-8cf1-2d284cd83383-tmp\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.129622 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.128489 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 20:48:41.129622 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129524 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-run-openvswitch\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.129622 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129606 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/305a40cd-a1ac-4b06-aa5f-c09c29459213-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.130123 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129638 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-systemd-units\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.130123 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129682 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-cni-bin\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.130123 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129712 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-ovnkube-config\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.130123 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129731 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-var-lib-cni-bin\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.130123 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129769 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-kubernetes\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.130123 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129851 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-sysctl-conf\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.130123 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129877 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5btxl\" (UniqueName: \"kubernetes.io/projected/32616bf4-ee78-4f72-b062-8497e3fee06d-kube-api-access-5btxl\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.130123 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129902 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqkwv\" (UniqueName: \"kubernetes.io/projected/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-kube-api-access-qqkwv\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.130123 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129942 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/305a40cd-a1ac-4b06-aa5f-c09c29459213-system-cni-dir\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.130123 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129967 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/305a40cd-a1ac-4b06-aa5f-c09c29459213-cni-binary-copy\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.130123 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.129994 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-run-k8s-cni-cncf-io\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.130123 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130032 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-multus-conf-dir\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.130123 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130059 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-registration-dir\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.130811 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130116 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-run-ovn\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.130811 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130149 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/305a40cd-a1ac-4b06-aa5f-c09c29459213-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.130811 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130220 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs\") pod \"network-metrics-daemon-f7qm4\" (UID: \"014fb632-7183-4ad8-a74e-838a8d162eef\") " pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:41.130811 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130237 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-run-multus-certs\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.130811 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130276 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-sysctl-d\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.130811 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130292 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-tuned\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.130811 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130306 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-node-log\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.130811 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130332 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-var-lib-cni-multus\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.130811 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130372 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-etc-kubernetes\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.130811 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130403 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-sys\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.130811 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130443 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmsq5\" (UniqueName: \"kubernetes.io/projected/c3cec350-f1a4-47f6-8cf1-2d284cd83383-kube-api-access-lmsq5\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.130811 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130473 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-slash\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.130811 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130492 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-run-systemd\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.130811 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130525 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-system-cni-dir\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.131584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130559 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-os-release\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.131584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130582 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-env-overrides\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.131584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130610 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-multus-cni-dir\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.131584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130636 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-run-netns\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.131584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130700 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-var-lib-kubelet\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.131584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130723 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15d6af7f-a295-4b83-8a7e-71280841ca8a-cni-binary-copy\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.131584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130789 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d418585-bb7c-41bd-ac8f-56bfaf494254-konnectivity-ca\") pod \"konnectivity-agent-qvt6g\" (UID: \"1d418585-bb7c-41bd-ac8f-56bfaf494254\") " pod="kube-system/konnectivity-agent-qvt6g" Jul 06 20:48:41.131584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130814 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-run\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.131584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130838 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-host\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.131584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130887 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-device-dir\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.131584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130913 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-etc-openvswitch\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.131584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130955 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15d6af7f-a295-4b83-8a7e-71280841ca8a-multus-daemon-config\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.131584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.130990 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-socket-dir\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.131584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.131029 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/305a40cd-a1ac-4b06-aa5f-c09c29459213-cnibin\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.132383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.131045 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-systemd\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.132383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.131061 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.132383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.131076 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-sys-fs\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.132383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.131114 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-cni-netd\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.132383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.131140 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-ovn-node-metrics-cert\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.132383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.131167 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-modprobe-d\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.132383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.131213 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.132383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.131300 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-run-netns\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.132383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.131338 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-cnibin\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.132383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.131450 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-hostroot\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.132383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.128243 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:48:41.133115 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.128389 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-stw6s\"" Jul 06 20:48:41.141394 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.141366 2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pqvjf" Jul 06 20:48:41.150332 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.150305 2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pqvjf" Jul 06 20:48:41.207970 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.207879 2586 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 20:48:41.212940 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.212889 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" event={"ID":"aa129323fd96e838d69ffbe2645f9ba4","Type":"ContainerStarted","Data":"e7bf36cfe3245939df2c9af077219a6518f673ee90f6fd0876f909d64d67ed99"} Jul 06 20:48:41.215465 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.215434 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" event={"ID":"93c5fe6b20d1f802096a59c4920e1e2c","Type":"ContainerStarted","Data":"fded0b72b6c1318bc273313b46257d6277b9d4c67ea92a607153d95336fecc4f"} Jul 06 20:48:41.232475 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232441 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-run-ovn\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.232657 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232490 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/305a40cd-a1ac-4b06-aa5f-c09c29459213-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.232657 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232530 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs\") pod \"network-metrics-daemon-f7qm4\" (UID: \"014fb632-7183-4ad8-a74e-838a8d162eef\") " pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:41.232657 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232558 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-run-multus-certs\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.232657 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232584 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-sysctl-d\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.232657 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232587 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-run-ovn\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.232657 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232608 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-tuned\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.232657 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232632 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-node-log\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.232982 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232667 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-var-lib-cni-multus\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.232982 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232697 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-etc-kubernetes\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.232982 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.232719 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:48:41.232982 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232728 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-sys\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.232982 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232759 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmsq5\" (UniqueName: \"kubernetes.io/projected/c3cec350-f1a4-47f6-8cf1-2d284cd83383-kube-api-access-lmsq5\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.232982 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.232792 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs podName:014fb632-7183-4ad8-a74e-838a8d162eef nodeName:}" failed. No retries permitted until 2026-07-06 20:48:41.732768483 +0000 UTC m=+3.066584982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs") pod "network-metrics-daemon-f7qm4" (UID: "014fb632-7183-4ad8-a74e-838a8d162eef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:48:41.232982 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232828 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-slash\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.232982 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232856 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-run-systemd\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.232982 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232882 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-system-cni-dir\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.232982 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232907 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-os-release\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.232982 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232937 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e83e41a-db4f-4835-b4e0-7d016601087d-iptables-alerter-script\") pod \"iptables-alerter-7wdzt\" (UID: \"1e83e41a-db4f-4835-b4e0-7d016601087d\") " pod="openshift-network-operator/iptables-alerter-7wdzt" Jul 06 20:48:41.232982 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232965 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-env-overrides\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.233723 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.232988 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-multus-cni-dir\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.233723 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233035 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-run-netns\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.233723 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233060 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-var-lib-kubelet\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.233723 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233077 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-run-multus-certs\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.233723 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233083 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15d6af7f-a295-4b83-8a7e-71280841ca8a-cni-binary-copy\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.233723 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233129 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d418585-bb7c-41bd-ac8f-56bfaf494254-konnectivity-ca\") pod \"konnectivity-agent-qvt6g\" (UID: \"1d418585-bb7c-41bd-ac8f-56bfaf494254\") " pod="kube-system/konnectivity-agent-qvt6g" Jul 06 20:48:41.233723 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233174 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-run\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.233723 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233200 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-host\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.233723 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233226 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-device-dir\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.233723 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233251 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-etc-openvswitch\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.233723 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233277 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15d6af7f-a295-4b83-8a7e-71280841ca8a-multus-daemon-config\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.233723 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233310 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-kubelet-config\") pod \"global-pull-secret-syncer-s4cpg\" (UID: \"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9\") " pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:41.233723 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233325 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-slash\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.233723 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233339 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-socket-dir\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.233723 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233368 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/305a40cd-a1ac-4b06-aa5f-c09c29459213-cnibin\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.234506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233375 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-run-systemd\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.234506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233394 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-systemd\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.234506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233422 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67b2b0d4-1e54-408e-ae39-a626171fd87c-host\") pod \"node-ca-2d92l\" (UID: \"67b2b0d4-1e54-408e-ae39-a626171fd87c\") " pod="openshift-image-registry/node-ca-2d92l" Jul 06 20:48:41.234506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233438 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-system-cni-dir\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.234506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233472 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.234506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233498 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-sys-fs\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.234506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233515 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-host\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.234506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233521 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-cni-netd\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.234506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233556 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-ovn-node-metrics-cert\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.234506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233555 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-cni-netd\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.234506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233579 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-device-dir\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.234506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233596 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-run\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.234506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233642 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-os-release\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.234506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233639 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/305a40cd-a1ac-4b06-aa5f-c09c29459213-cnibin\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.234506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233690 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-systemd\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.235266 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233696 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-modprobe-d\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.235266 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233713 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-sysctl-d\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.235266 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233830 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-socket-dir\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.235266 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233874 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-etc-openvswitch\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.235266 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234039 2586 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 20:48:41.235266 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234079 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-node-log\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.235266 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234132 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-var-lib-cni-multus\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.235266 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234198 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-etc-kubernetes\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.235266 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234213 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-env-overrides\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.235266 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234253 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-sys\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.235266 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234328 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15d6af7f-a295-4b83-8a7e-71280841ca8a-multus-daemon-config\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.235266 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233585 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-modprobe-d\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.235266 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234388 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-run-netns\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.235266 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234354 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-multus-cni-dir\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.235266 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234387 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381-tmp-dir\") pod \"node-resolver-pzt4k\" (UID: \"37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381\") " pod="openshift-dns/node-resolver-pzt4k" Jul 06 20:48:41.235953 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234435 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-dbus\") pod \"global-pull-secret-syncer-s4cpg\" (UID: \"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9\") " pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:41.235953 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234453 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-var-lib-kubelet\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.235953 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234465 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret\") pod \"global-pull-secret-syncer-s4cpg\" (UID: \"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9\") " pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:41.235953 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234526 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-sys-fs\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.235953 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.233497 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/305a40cd-a1ac-4b06-aa5f-c09c29459213-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.235953 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234624 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.235953 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234686 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15d6af7f-a295-4b83-8a7e-71280841ca8a-cni-binary-copy\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.235953 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234804 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.235953 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234836 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-run-netns\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.235953 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234861 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-cnibin\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.235953 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234858 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.235953 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.234960 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d418585-bb7c-41bd-ac8f-56bfaf494254-konnectivity-ca\") pod \"konnectivity-agent-qvt6g\" (UID: \"1d418585-bb7c-41bd-ac8f-56bfaf494254\") " pod="kube-system/konnectivity-agent-qvt6g" Jul 06 20:48:41.235953 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.235410 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-run-netns\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.235953 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.235454 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-hostroot\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.236611 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.235509 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-hostroot\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.236611 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.235511 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-cnibin\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.236611 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.235543 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-lib-modules\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.236611 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.235572 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-var-lib-openvswitch\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.236611 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.235602 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-ovnkube-script-lib\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.236611 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.235630 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frmbb\" (UniqueName: \"kubernetes.io/projected/305a40cd-a1ac-4b06-aa5f-c09c29459213-kube-api-access-frmbb\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.236611 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.235637 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-var-lib-openvswitch\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.236611 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.235652 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-lib-modules\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.236611 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.235660 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcgx5\" (UniqueName: \"kubernetes.io/projected/014fb632-7183-4ad8-a74e-838a8d162eef-kube-api-access-qcgx5\") pod \"network-metrics-daemon-f7qm4\" (UID: \"014fb632-7183-4ad8-a74e-838a8d162eef\") " pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:41.236611 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.235758 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdcnk\" (UniqueName: \"kubernetes.io/projected/15d6af7f-a295-4b83-8a7e-71280841ca8a-kube-api-access-qdcnk\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.236611 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.235793 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d418585-bb7c-41bd-ac8f-56bfaf494254-agent-certs\") pod \"konnectivity-agent-qvt6g\" (UID: \"1d418585-bb7c-41bd-ac8f-56bfaf494254\") " pod="kube-system/konnectivity-agent-qvt6g" Jul 06 20:48:41.236611 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.235821 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-var-lib-kubelet\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.236611 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.235883 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-var-lib-kubelet\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.236611 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.235941 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htc5b\" (UniqueName: \"kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b\") pod \"network-check-target-rp2sj\" (UID: \"a2ec5721-43da-420a-979e-8d87ce647c73\") " pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:48:41.237323 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.235989 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-run-ovn-kubernetes\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.237323 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.236021 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d4ck\" (UniqueName: \"kubernetes.io/projected/67b2b0d4-1e54-408e-ae39-a626171fd87c-kube-api-access-2d4ck\") pod \"node-ca-2d92l\" (UID: \"67b2b0d4-1e54-408e-ae39-a626171fd87c\") " pod="openshift-image-registry/node-ca-2d92l" Jul 06 20:48:41.237323 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.236051 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e83e41a-db4f-4835-b4e0-7d016601087d-host-slash\") pod \"iptables-alerter-7wdzt\" (UID: \"1e83e41a-db4f-4835-b4e0-7d016601087d\") " pod="openshift-network-operator/iptables-alerter-7wdzt" Jul 06 20:48:41.237323 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.236094 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-run-ovn-kubernetes\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.237323 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.236117 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-kubelet\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.237323 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.236162 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-log-socket\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.237323 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.236237 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-ovnkube-script-lib\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.241192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.236296 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.241192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.238250 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-kubelet\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.241192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.236198 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.241192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239028 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/305a40cd-a1ac-4b06-aa5f-c09c29459213-os-release\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.241192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239067 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/305a40cd-a1ac-4b06-aa5f-c09c29459213-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.241192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239101 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-multus-socket-dir-parent\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.241192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239127 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-sysconfig\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.241192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239172 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3cec350-f1a4-47f6-8cf1-2d284cd83383-tmp\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.241192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239206 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-run-openvswitch\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.241192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239237 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/305a40cd-a1ac-4b06-aa5f-c09c29459213-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.241192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239267 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381-hosts-file\") pod \"node-resolver-pzt4k\" (UID: \"37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381\") " pod="openshift-dns/node-resolver-pzt4k" Jul 06 20:48:41.241192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239300 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flxlk\" (UniqueName: \"kubernetes.io/projected/1e83e41a-db4f-4835-b4e0-7d016601087d-kube-api-access-flxlk\") pod \"iptables-alerter-7wdzt\" (UID: \"1e83e41a-db4f-4835-b4e0-7d016601087d\") " pod="openshift-network-operator/iptables-alerter-7wdzt" Jul 06 20:48:41.241192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239336 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-systemd-units\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.241192 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239371 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-cni-bin\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.241973 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239402 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-ovnkube-config\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.241973 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239427 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-var-lib-cni-bin\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.241973 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239457 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-kubernetes\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.241973 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239487 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-sysctl-conf\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.241973 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239523 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vx6w\" (UniqueName: \"kubernetes.io/projected/37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381-kube-api-access-9vx6w\") pod \"node-resolver-pzt4k\" (UID: \"37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381\") " pod="openshift-dns/node-resolver-pzt4k" Jul 06 20:48:41.241973 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239555 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67b2b0d4-1e54-408e-ae39-a626171fd87c-serviceca\") pod \"node-ca-2d92l\" (UID: \"67b2b0d4-1e54-408e-ae39-a626171fd87c\") " pod="openshift-image-registry/node-ca-2d92l" Jul 06 20:48:41.241973 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239582 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5btxl\" (UniqueName: \"kubernetes.io/projected/32616bf4-ee78-4f72-b062-8497e3fee06d-kube-api-access-5btxl\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.241973 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239614 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqkwv\" (UniqueName: \"kubernetes.io/projected/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-kube-api-access-qqkwv\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.241973 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239647 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/305a40cd-a1ac-4b06-aa5f-c09c29459213-system-cni-dir\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.241973 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239679 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/305a40cd-a1ac-4b06-aa5f-c09c29459213-cni-binary-copy\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.241973 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239706 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-run-k8s-cni-cncf-io\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.241973 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239738 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-multus-conf-dir\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.241973 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239775 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-registration-dir\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.241973 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239893 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/32616bf4-ee78-4f72-b062-8497e3fee06d-registration-dir\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.242709 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.238923 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-log-socket\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.242709 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.239982 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/305a40cd-a1ac-4b06-aa5f-c09c29459213-os-release\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.242709 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.240155 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-var-lib-cni-bin\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.242709 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.240237 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-multus-socket-dir-parent\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.242709 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.240265 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-ovn-node-metrics-cert\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.242709 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.240282 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-sysconfig\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.242709 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.240484 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/305a40cd-a1ac-4b06-aa5f-c09c29459213-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.242709 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.240571 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-kubernetes\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.242709 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.240696 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-sysctl-conf\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.242709 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.241137 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-run-openvswitch\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.242709 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.241244 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-multus-conf-dir\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.242709 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.241360 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-systemd-units\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.242709 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.241393 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/305a40cd-a1ac-4b06-aa5f-c09c29459213-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.242709 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.241428 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-host-cni-bin\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.242709 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.241847 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/305a40cd-a1ac-4b06-aa5f-c09c29459213-cni-binary-copy\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.243494 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.241911 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15d6af7f-a295-4b83-8a7e-71280841ca8a-host-run-k8s-cni-cncf-io\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.243494 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.241965 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/305a40cd-a1ac-4b06-aa5f-c09c29459213-system-cni-dir\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.243494 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.242605 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-ovnkube-config\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.243718 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.243641 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:48:41.243718 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.243671 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:48:41.243718 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.243687 2586 projected.go:196] Error preparing data for projected volume kube-api-access-htc5b for pod openshift-network-diagnostics/network-check-target-rp2sj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:48:41.243880 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.243777 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b podName:a2ec5721-43da-420a-979e-8d87ce647c73 nodeName:}" failed. No retries permitted until 2026-07-06 20:48:41.743757301 +0000 UTC m=+3.077573805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-htc5b" (UniqueName: "kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b") pod "network-check-target-rp2sj" (UID: "a2ec5721-43da-420a-979e-8d87ce647c73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:48:41.245850 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.245369 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3cec350-f1a4-47f6-8cf1-2d284cd83383-tmp\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.248726 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.248653 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmsq5\" (UniqueName: \"kubernetes.io/projected/c3cec350-f1a4-47f6-8cf1-2d284cd83383-kube-api-access-lmsq5\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.249837 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.249400 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d418585-bb7c-41bd-ac8f-56bfaf494254-agent-certs\") pod \"konnectivity-agent-qvt6g\" (UID: \"1d418585-bb7c-41bd-ac8f-56bfaf494254\") " pod="kube-system/konnectivity-agent-qvt6g" Jul 06 20:48:41.249837 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.249455 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frmbb\" (UniqueName: \"kubernetes.io/projected/305a40cd-a1ac-4b06-aa5f-c09c29459213-kube-api-access-frmbb\") pod \"multus-additional-cni-plugins-nwzh6\" (UID: \"305a40cd-a1ac-4b06-aa5f-c09c29459213\") " pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.250072 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.250043 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3cec350-f1a4-47f6-8cf1-2d284cd83383-etc-tuned\") pod \"tuned-9lg84\" (UID: \"c3cec350-f1a4-47f6-8cf1-2d284cd83383\") " pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.251921 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.251206 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcgx5\" (UniqueName: \"kubernetes.io/projected/014fb632-7183-4ad8-a74e-838a8d162eef-kube-api-access-qcgx5\") pod \"network-metrics-daemon-f7qm4\" (UID: \"014fb632-7183-4ad8-a74e-838a8d162eef\") " pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:41.252705 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.252643 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdcnk\" (UniqueName: \"kubernetes.io/projected/15d6af7f-a295-4b83-8a7e-71280841ca8a-kube-api-access-qdcnk\") pod \"multus-rkktm\" (UID: \"15d6af7f-a295-4b83-8a7e-71280841ca8a\") " pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.254585 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.254559 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqkwv\" (UniqueName: \"kubernetes.io/projected/d32abe9d-5c42-41b8-aacf-0fdd0cf34c18-kube-api-access-qqkwv\") pod \"ovnkube-node-gl8x4\" (UID: \"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.254805 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.254779 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5btxl\" (UniqueName: \"kubernetes.io/projected/32616bf4-ee78-4f72-b062-8497e3fee06d-kube-api-access-5btxl\") pod \"aws-ebs-csi-driver-node-xrwqv\" (UID: \"32616bf4-ee78-4f72-b062-8497e3fee06d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.292937 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.292888 2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:48:41.341100 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340133 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vx6w\" (UniqueName: \"kubernetes.io/projected/37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381-kube-api-access-9vx6w\") pod \"node-resolver-pzt4k\" (UID: \"37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381\") " pod="openshift-dns/node-resolver-pzt4k" Jul 06 20:48:41.341100 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340182 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67b2b0d4-1e54-408e-ae39-a626171fd87c-serviceca\") pod \"node-ca-2d92l\" (UID: \"67b2b0d4-1e54-408e-ae39-a626171fd87c\") " pod="openshift-image-registry/node-ca-2d92l" Jul 06 20:48:41.341100 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340242 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e83e41a-db4f-4835-b4e0-7d016601087d-iptables-alerter-script\") pod \"iptables-alerter-7wdzt\" (UID: \"1e83e41a-db4f-4835-b4e0-7d016601087d\") " pod="openshift-network-operator/iptables-alerter-7wdzt" Jul 06 20:48:41.341100 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340274 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-kubelet-config\") pod \"global-pull-secret-syncer-s4cpg\" (UID: \"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9\") " pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:41.341100 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340303 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67b2b0d4-1e54-408e-ae39-a626171fd87c-host\") pod \"node-ca-2d92l\" (UID: \"67b2b0d4-1e54-408e-ae39-a626171fd87c\") " pod="openshift-image-registry/node-ca-2d92l" Jul 06 20:48:41.341100 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340330 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381-tmp-dir\") pod \"node-resolver-pzt4k\" (UID: \"37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381\") " pod="openshift-dns/node-resolver-pzt4k" Jul 06 20:48:41.341100 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340353 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-dbus\") pod \"global-pull-secret-syncer-s4cpg\" (UID: \"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9\") " pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:41.341100 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340391 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret\") pod \"global-pull-secret-syncer-s4cpg\" (UID: \"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9\") " pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:41.341100 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340443 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d4ck\" (UniqueName: \"kubernetes.io/projected/67b2b0d4-1e54-408e-ae39-a626171fd87c-kube-api-access-2d4ck\") pod \"node-ca-2d92l\" (UID: \"67b2b0d4-1e54-408e-ae39-a626171fd87c\") " pod="openshift-image-registry/node-ca-2d92l" Jul 06 20:48:41.341100 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340466 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e83e41a-db4f-4835-b4e0-7d016601087d-host-slash\") pod \"iptables-alerter-7wdzt\" (UID: \"1e83e41a-db4f-4835-b4e0-7d016601087d\") " pod="openshift-network-operator/iptables-alerter-7wdzt" Jul 06 20:48:41.341100 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.340571 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:48:41.341100 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.340643 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret podName:01a651e4-e3a5-4a70-870d-9ed3c9bfacb9 nodeName:}" failed. No retries permitted until 2026-07-06 20:48:41.840624597 +0000 UTC m=+3.174441103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret") pod "global-pull-secret-syncer-s4cpg" (UID: "01a651e4-e3a5-4a70-870d-9ed3c9bfacb9") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:48:41.341100 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340785 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67b2b0d4-1e54-408e-ae39-a626171fd87c-serviceca\") pod \"node-ca-2d92l\" (UID: \"67b2b0d4-1e54-408e-ae39-a626171fd87c\") " pod="openshift-image-registry/node-ca-2d92l" Jul 06 20:48:41.341100 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340796 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67b2b0d4-1e54-408e-ae39-a626171fd87c-host\") pod \"node-ca-2d92l\" (UID: \"67b2b0d4-1e54-408e-ae39-a626171fd87c\") " pod="openshift-image-registry/node-ca-2d92l" Jul 06 20:48:41.341882 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340838 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381-tmp-dir\") pod \"node-resolver-pzt4k\" (UID: \"37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381\") " pod="openshift-dns/node-resolver-pzt4k" Jul 06 20:48:41.341882 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340847 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381-hosts-file\") pod \"node-resolver-pzt4k\" (UID: \"37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381\") " pod="openshift-dns/node-resolver-pzt4k" Jul 06 20:48:41.341882 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340880 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flxlk\" (UniqueName: \"kubernetes.io/projected/1e83e41a-db4f-4835-b4e0-7d016601087d-kube-api-access-flxlk\") pod \"iptables-alerter-7wdzt\" (UID: \"1e83e41a-db4f-4835-b4e0-7d016601087d\") " pod="openshift-network-operator/iptables-alerter-7wdzt" Jul 06 20:48:41.341882 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340904 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-dbus\") pod \"global-pull-secret-syncer-s4cpg\" (UID: \"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9\") " pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:41.341882 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340965 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e83e41a-db4f-4835-b4e0-7d016601087d-host-slash\") pod \"iptables-alerter-7wdzt\" (UID: \"1e83e41a-db4f-4835-b4e0-7d016601087d\") " pod="openshift-network-operator/iptables-alerter-7wdzt" Jul 06 20:48:41.341882 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.340968 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381-hosts-file\") pod \"node-resolver-pzt4k\" (UID: \"37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381\") " pod="openshift-dns/node-resolver-pzt4k" Jul 06 20:48:41.341882 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.341017 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-kubelet-config\") pod \"global-pull-secret-syncer-s4cpg\" (UID: \"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9\") " pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:41.341882 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.341032 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e83e41a-db4f-4835-b4e0-7d016601087d-iptables-alerter-script\") pod \"iptables-alerter-7wdzt\" (UID: \"1e83e41a-db4f-4835-b4e0-7d016601087d\") " pod="openshift-network-operator/iptables-alerter-7wdzt" Jul 06 20:48:41.352448 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.352419 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vx6w\" (UniqueName: \"kubernetes.io/projected/37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381-kube-api-access-9vx6w\") pod \"node-resolver-pzt4k\" (UID: \"37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381\") " pod="openshift-dns/node-resolver-pzt4k" Jul 06 20:48:41.352624 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.352463 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flxlk\" (UniqueName: \"kubernetes.io/projected/1e83e41a-db4f-4835-b4e0-7d016601087d-kube-api-access-flxlk\") pod \"iptables-alerter-7wdzt\" (UID: \"1e83e41a-db4f-4835-b4e0-7d016601087d\") " pod="openshift-network-operator/iptables-alerter-7wdzt" Jul 06 20:48:41.353134 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.353064 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d4ck\" (UniqueName: \"kubernetes.io/projected/67b2b0d4-1e54-408e-ae39-a626171fd87c-kube-api-access-2d4ck\") pod \"node-ca-2d92l\" (UID: \"67b2b0d4-1e54-408e-ae39-a626171fd87c\") " pod="openshift-image-registry/node-ca-2d92l" Jul 06 20:48:41.408204 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.408164 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:48:41.418584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.418558 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rkktm" Jul 06 20:48:41.418701 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:41.418671 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32abe9d_5c42_41b8_aacf_0fdd0cf34c18.slice/crio-299acb4b52c792bb956d961990533db982892f63d114593d9df6a95a03122d9e WatchSource:0}: Error finding container 299acb4b52c792bb956d961990533db982892f63d114593d9df6a95a03122d9e: Status 404 returned error can't find the container with id 299acb4b52c792bb956d961990533db982892f63d114593d9df6a95a03122d9e Jul 06 20:48:41.435092 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.435050 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qvt6g" Jul 06 20:48:41.442149 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.442119 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9lg84" Jul 06 20:48:41.461246 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.461216 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nwzh6" Jul 06 20:48:41.468380 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.468355 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" Jul 06 20:48:41.475379 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.475358 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2d92l" Jul 06 20:48:41.482309 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.482290 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pzt4k" Jul 06 20:48:41.491261 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.491233 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7wdzt" Jul 06 20:48:41.743766 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.743722 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs\") pod \"network-metrics-daemon-f7qm4\" (UID: \"014fb632-7183-4ad8-a74e-838a8d162eef\") " pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:41.743978 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.743921 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:48:41.744042 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.744012 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs podName:014fb632-7183-4ad8-a74e-838a8d162eef nodeName:}" failed. No retries permitted until 2026-07-06 20:48:42.743988512 +0000 UTC m=+4.077805030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs") pod "network-metrics-daemon-f7qm4" (UID: "014fb632-7183-4ad8-a74e-838a8d162eef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:48:41.844943 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.844886 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret\") pod \"global-pull-secret-syncer-s4cpg\" (UID: \"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9\") " pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:41.845141 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:41.844969 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htc5b\" (UniqueName: \"kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b\") pod \"network-check-target-rp2sj\" (UID: \"a2ec5721-43da-420a-979e-8d87ce647c73\") " pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:48:41.845141 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.845060 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:48:41.845228 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.845139 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:48:41.845228 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.845160 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:48:41.845228 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.845170 2586 projected.go:196] Error preparing data for projected volume kube-api-access-htc5b for pod openshift-network-diagnostics/network-check-target-rp2sj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:48:41.845228 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.845140 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret podName:01a651e4-e3a5-4a70-870d-9ed3c9bfacb9 nodeName:}" failed. No retries permitted until 2026-07-06 20:48:42.845122166 +0000 UTC m=+4.178938661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret") pod "global-pull-secret-syncer-s4cpg" (UID: "01a651e4-e3a5-4a70-870d-9ed3c9bfacb9") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:48:41.845364 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:41.845229 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b podName:a2ec5721-43da-420a-979e-8d87ce647c73 nodeName:}" failed. No retries permitted until 2026-07-06 20:48:42.845214117 +0000 UTC m=+4.179030615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-htc5b" (UniqueName: "kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b") pod "network-check-target-rp2sj" (UID: "a2ec5721-43da-420a-979e-8d87ce647c73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:48:42.154232 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:42.154151 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:43:41 +0000 UTC" deadline="2028-01-25 23:35:09.307242512 +0000 UTC" Jul 06 20:48:42.154232 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:42.154188 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13634h46m27.153058436s" Jul 06 20:48:42.218135 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:42.218098 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" event={"ID":"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18","Type":"ContainerStarted","Data":"299acb4b52c792bb956d961990533db982892f63d114593d9df6a95a03122d9e"} Jul 06 20:48:42.559432 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:42.559269 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f92bd2_9e2e_4f5a_b8fd_c4291f3b9381.slice/crio-aa3e1b30a4166afb25edc5dc9f57321ab387a11b297897afc07ab566f468f791 WatchSource:0}: Error finding container aa3e1b30a4166afb25edc5dc9f57321ab387a11b297897afc07ab566f468f791: Status 404 returned error can't find the container with id aa3e1b30a4166afb25edc5dc9f57321ab387a11b297897afc07ab566f468f791 Jul 06 20:48:42.563623 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:42.563576 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b2b0d4_1e54_408e_ae39_a626171fd87c.slice/crio-969afcc7eb75e7d05e64740a8eb42c1ac99dd855cc2fa719e3ee782b1efd4dc4 WatchSource:0}: Error finding container 969afcc7eb75e7d05e64740a8eb42c1ac99dd855cc2fa719e3ee782b1efd4dc4: Status 404 returned error can't find the container with id 969afcc7eb75e7d05e64740a8eb42c1ac99dd855cc2fa719e3ee782b1efd4dc4 Jul 06 20:48:42.564824 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:42.564338 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3cec350_f1a4_47f6_8cf1_2d284cd83383.slice/crio-fba63102204c5f32787c726c4d37c32b207a9e658fda66a929237a437bd22205 WatchSource:0}: Error finding container fba63102204c5f32787c726c4d37c32b207a9e658fda66a929237a437bd22205: Status 404 returned error can't find the container with id fba63102204c5f32787c726c4d37c32b207a9e658fda66a929237a437bd22205 Jul 06 20:48:42.565804 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:42.565741 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d6af7f_a295_4b83_8a7e_71280841ca8a.slice/crio-01a0e668a60b9adc5990e529b32dd817e89cdf974838d5c5b3948080cd4cc3aa WatchSource:0}: Error finding container 01a0e668a60b9adc5990e529b32dd817e89cdf974838d5c5b3948080cd4cc3aa: Status 404 returned error can't find the container with id 01a0e668a60b9adc5990e529b32dd817e89cdf974838d5c5b3948080cd4cc3aa Jul 06 20:48:42.566929 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:42.566769 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32616bf4_ee78_4f72_b062_8497e3fee06d.slice/crio-07634a63a72ed51a6f3a696b3da63c4f3e2120850500a048d29e0cb7d47c853a WatchSource:0}: Error finding container 07634a63a72ed51a6f3a696b3da63c4f3e2120850500a048d29e0cb7d47c853a: Status 404 returned error can't find the container with id 07634a63a72ed51a6f3a696b3da63c4f3e2120850500a048d29e0cb7d47c853a Jul 06 20:48:42.567910 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:42.567890 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e83e41a_db4f_4835_b4e0_7d016601087d.slice/crio-3b029fb002fe91754795a5e1c0bab180a0775f7a0cde15b39467d15e2af7bcf8 WatchSource:0}: Error finding container 3b029fb002fe91754795a5e1c0bab180a0775f7a0cde15b39467d15e2af7bcf8: Status 404 returned error can't find the container with id 3b029fb002fe91754795a5e1c0bab180a0775f7a0cde15b39467d15e2af7bcf8 Jul 06 20:48:42.570748 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:42.570379 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d418585_bb7c_41bd_ac8f_56bfaf494254.slice/crio-aa4f4583314f4cf0683f5f64d5bc9c0848e88637f176959e1723dc544cd43256 WatchSource:0}: Error finding container aa4f4583314f4cf0683f5f64d5bc9c0848e88637f176959e1723dc544cd43256: Status 404 returned error can't find the container with id aa4f4583314f4cf0683f5f64d5bc9c0848e88637f176959e1723dc544cd43256 Jul 06 20:48:42.571464 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:48:42.571412 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod305a40cd_a1ac_4b06_aa5f_c09c29459213.slice/crio-7fa9d4ab0d88c5b4aa3f83fd0392be4224586f2690d0a6b131c29e80c20bd517 WatchSource:0}: Error finding container 7fa9d4ab0d88c5b4aa3f83fd0392be4224586f2690d0a6b131c29e80c20bd517: Status 404 returned error can't find the container with id 7fa9d4ab0d88c5b4aa3f83fd0392be4224586f2690d0a6b131c29e80c20bd517 Jul 06 20:48:42.621964 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:42.621936 2586 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:48:42.752612 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:42.752572 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs\") pod \"network-metrics-daemon-f7qm4\" (UID: \"014fb632-7183-4ad8-a74e-838a8d162eef\") " pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:42.752801 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:42.752734 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:48:42.752855 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:42.752822 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs podName:014fb632-7183-4ad8-a74e-838a8d162eef nodeName:}" failed. No retries permitted until 2026-07-06 20:48:44.752800053 +0000 UTC m=+6.086616549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs") pod "network-metrics-daemon-f7qm4" (UID: "014fb632-7183-4ad8-a74e-838a8d162eef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:48:42.853940 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:42.853675 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret\") pod \"global-pull-secret-syncer-s4cpg\" (UID: \"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9\") " pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:42.854124 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:42.853966 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htc5b\" (UniqueName: \"kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b\") pod \"network-check-target-rp2sj\" (UID: \"a2ec5721-43da-420a-979e-8d87ce647c73\") " pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:48:42.854124 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:42.853855 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:48:42.854124 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:42.854049 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret podName:01a651e4-e3a5-4a70-870d-9ed3c9bfacb9 nodeName:}" failed. No retries permitted until 2026-07-06 20:48:44.85402683 +0000 UTC m=+6.187843341 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret") pod "global-pull-secret-syncer-s4cpg" (UID: "01a651e4-e3a5-4a70-870d-9ed3c9bfacb9") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:48:42.854124 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:42.854097 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:48:42.854124 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:42.854115 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:48:42.854415 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:42.854128 2586 projected.go:196] Error preparing data for projected volume kube-api-access-htc5b for pod openshift-network-diagnostics/network-check-target-rp2sj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:48:42.854415 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:42.854195 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b podName:a2ec5721-43da-420a-979e-8d87ce647c73 nodeName:}" failed. No retries permitted until 2026-07-06 20:48:44.854180561 +0000 UTC m=+6.187997075 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-htc5b" (UniqueName: "kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b") pod "network-check-target-rp2sj" (UID: "a2ec5721-43da-420a-979e-8d87ce647c73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:48:43.155442 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:43.155322 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:43:41 +0000 UTC" deadline="2028-02-11 21:44:39.05838707 +0000 UTC" Jul 06 20:48:43.155442 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:43.155394 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14040h55m55.902997877s" Jul 06 20:48:43.209419 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:43.209291 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:48:43.209419 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:43.209346 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:43.210114 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:43.209431 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:48:43.210114 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:43.209786 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:43.210114 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:43.209954 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:48:43.210114 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:43.209999 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:48:43.224885 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:43.224219 2586 generic.go:356] "Generic (PLEG): container finished" podID="aa129323fd96e838d69ffbe2645f9ba4" containerID="78cebcaabeeefc73bf15d6581ccd2870b2e877aae7b8fe0214807b7ff3a93973" exitCode=0 Jul 06 20:48:43.224885 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:43.224308 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" event={"ID":"aa129323fd96e838d69ffbe2645f9ba4","Type":"ContainerDied","Data":"78cebcaabeeefc73bf15d6581ccd2870b2e877aae7b8fe0214807b7ff3a93973"} Jul 06 20:48:43.226435 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:43.226370 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwzh6" event={"ID":"305a40cd-a1ac-4b06-aa5f-c09c29459213","Type":"ContainerStarted","Data":"7fa9d4ab0d88c5b4aa3f83fd0392be4224586f2690d0a6b131c29e80c20bd517"} Jul 06 20:48:43.228904 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:43.228877 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9lg84" event={"ID":"c3cec350-f1a4-47f6-8cf1-2d284cd83383","Type":"ContainerStarted","Data":"fba63102204c5f32787c726c4d37c32b207a9e658fda66a929237a437bd22205"} Jul 06 20:48:43.235011 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:43.234981 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7wdzt" event={"ID":"1e83e41a-db4f-4835-b4e0-7d016601087d","Type":"ContainerStarted","Data":"3b029fb002fe91754795a5e1c0bab180a0775f7a0cde15b39467d15e2af7bcf8"} Jul 06 20:48:43.239414 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:43.239318 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" event={"ID":"32616bf4-ee78-4f72-b062-8497e3fee06d","Type":"ContainerStarted","Data":"07634a63a72ed51a6f3a696b3da63c4f3e2120850500a048d29e0cb7d47c853a"} Jul 06 20:48:43.241825 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:43.241746 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2d92l" event={"ID":"67b2b0d4-1e54-408e-ae39-a626171fd87c","Type":"ContainerStarted","Data":"969afcc7eb75e7d05e64740a8eb42c1ac99dd855cc2fa719e3ee782b1efd4dc4"} Jul 06 20:48:43.246846 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:43.246820 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pzt4k" event={"ID":"37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381","Type":"ContainerStarted","Data":"aa3e1b30a4166afb25edc5dc9f57321ab387a11b297897afc07ab566f468f791"} Jul 06 20:48:43.250394 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:43.250358 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" event={"ID":"93c5fe6b20d1f802096a59c4920e1e2c","Type":"ContainerStarted","Data":"a969090f9ae157d89f496dd248378dd74c32980d2d9f79159e48994d257ff6aa"} Jul 06 20:48:43.262003 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:43.261973 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qvt6g" event={"ID":"1d418585-bb7c-41bd-ac8f-56bfaf494254","Type":"ContainerStarted","Data":"aa4f4583314f4cf0683f5f64d5bc9c0848e88637f176959e1723dc544cd43256"} Jul 06 20:48:43.267009 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:43.266979 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rkktm" event={"ID":"15d6af7f-a295-4b83-8a7e-71280841ca8a","Type":"ContainerStarted","Data":"01a0e668a60b9adc5990e529b32dd817e89cdf974838d5c5b3948080cd4cc3aa"} Jul 06 20:48:43.270045 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:43.269966 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" podStartSLOduration=3.269949587 podStartE2EDuration="3.269949587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:48:43.269479133 +0000 UTC m=+4.603295645" watchObservedRunningTime="2026-07-06 20:48:43.269949587 +0000 UTC m=+4.603766101" Jul 06 20:48:44.287829 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:44.287788 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" event={"ID":"aa129323fd96e838d69ffbe2645f9ba4","Type":"ContainerStarted","Data":"6aee8119f73f4124adfca33e160e8cb9451dbee07ece238824bfa39dafc414ed"} Jul 06 20:48:44.773994 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:44.773377 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs\") pod \"network-metrics-daemon-f7qm4\" (UID: \"014fb632-7183-4ad8-a74e-838a8d162eef\") " pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:44.773994 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:44.773562 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:48:44.773994 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:44.773625 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs podName:014fb632-7183-4ad8-a74e-838a8d162eef nodeName:}" failed. No retries permitted until 2026-07-06 20:48:48.773606466 +0000 UTC m=+10.107422959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs") pod "network-metrics-daemon-f7qm4" (UID: "014fb632-7183-4ad8-a74e-838a8d162eef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:48:44.874198 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:44.874159 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret\") pod \"global-pull-secret-syncer-s4cpg\" (UID: \"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9\") " pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:44.874383 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:44.874218 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htc5b\" (UniqueName: \"kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b\") pod \"network-check-target-rp2sj\" (UID: \"a2ec5721-43da-420a-979e-8d87ce647c73\") " pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:48:44.874444 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:44.874394 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:48:44.874444 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:44.874414 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:48:44.874444 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:44.874427 2586 projected.go:196] Error preparing data for projected volume kube-api-access-htc5b for pod openshift-network-diagnostics/network-check-target-rp2sj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:48:44.874590 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:44.874486 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b podName:a2ec5721-43da-420a-979e-8d87ce647c73 nodeName:}" failed. No retries permitted until 2026-07-06 20:48:48.874465152 +0000 UTC m=+10.208281647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-htc5b" (UniqueName: "kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b") pod "network-check-target-rp2sj" (UID: "a2ec5721-43da-420a-979e-8d87ce647c73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:48:44.874900 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:44.874874 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:48:44.874997 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:44.874927 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret podName:01a651e4-e3a5-4a70-870d-9ed3c9bfacb9 nodeName:}" failed. No retries permitted until 2026-07-06 20:48:48.874913174 +0000 UTC m=+10.208729669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret") pod "global-pull-secret-syncer-s4cpg" (UID: "01a651e4-e3a5-4a70-870d-9ed3c9bfacb9") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:48:45.208206 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:45.208174 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:45.208390 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:45.208311 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:48:45.208652 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:45.208174 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:48:45.208755 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:45.208732 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:48:45.208832 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:45.208818 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:45.208925 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:45.208907 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:48:47.207992 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:47.207606 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:48:47.207992 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:47.207630 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:47.207992 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:47.207710 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:48:47.207992 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:47.207762 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:48:47.207992 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:47.207814 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:47.207992 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:47.207916 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:48:48.809611 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:48.809570 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs\") pod \"network-metrics-daemon-f7qm4\" (UID: \"014fb632-7183-4ad8-a74e-838a8d162eef\") " pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:48.810184 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:48.809796 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:48:48.810184 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:48.809866 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs podName:014fb632-7183-4ad8-a74e-838a8d162eef nodeName:}" failed. No retries permitted until 2026-07-06 20:48:56.809845603 +0000 UTC m=+18.143662095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs") pod "network-metrics-daemon-f7qm4" (UID: "014fb632-7183-4ad8-a74e-838a8d162eef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:48:48.910730 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:48.910695 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret\") pod \"global-pull-secret-syncer-s4cpg\" (UID: \"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9\") " pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:48.910919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:48.910754 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htc5b\" (UniqueName: \"kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b\") pod \"network-check-target-rp2sj\" (UID: \"a2ec5721-43da-420a-979e-8d87ce647c73\") " pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:48:48.910919 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:48.910912 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:48:48.911026 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:48.910931 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:48:48.911026 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:48.910943 2586 projected.go:196] Error preparing data for projected volume kube-api-access-htc5b for pod openshift-network-diagnostics/network-check-target-rp2sj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:48:48.911026 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:48.911000 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b podName:a2ec5721-43da-420a-979e-8d87ce647c73 nodeName:}" failed. No retries permitted until 2026-07-06 20:48:56.910982334 +0000 UTC m=+18.244798827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-htc5b" (UniqueName: "kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b") pod "network-check-target-rp2sj" (UID: "a2ec5721-43da-420a-979e-8d87ce647c73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:48:48.911429 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:48.911313 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:48:48.911429 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:48.911381 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret podName:01a651e4-e3a5-4a70-870d-9ed3c9bfacb9 nodeName:}" failed. No retries permitted until 2026-07-06 20:48:56.911363045 +0000 UTC m=+18.245179561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret") pod "global-pull-secret-syncer-s4cpg" (UID: "01a651e4-e3a5-4a70-870d-9ed3c9bfacb9") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:48:49.208214 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:49.208181 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:48:49.208402 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:49.208220 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:49.208402 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:49.208311 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:48:49.208757 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:49.208729 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:48:49.208857 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:49.208786 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:49.208921 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:49.208869 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:48:51.208030 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:51.207977 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:48:51.208516 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:51.208116 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:48:51.208516 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:51.208166 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:51.208516 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:51.208242 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:48:51.208516 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:51.208344 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:51.208516 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:51.208466 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:48:53.208328 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:53.208245 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:53.208737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:53.208245 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:53.208737 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:53.208368 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:48:53.208737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:53.208253 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:48:53.208737 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:53.208436 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:48:53.208737 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:53.208513 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:48:54.313912 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:54.313869 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwzh6" event={"ID":"305a40cd-a1ac-4b06-aa5f-c09c29459213","Type":"ContainerStarted","Data":"0ff9ea78a8c4abb7f74ed345cd07675c495d0321c078520c58828c1837f28654"} Jul 06 20:48:54.315467 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:54.315438 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9lg84" event={"ID":"c3cec350-f1a4-47f6-8cf1-2d284cd83383","Type":"ContainerStarted","Data":"f68e4411a17bb2d2cbe493ab8d54ca9518115aa5836315d594f597873195b788"} Jul 06 20:48:54.316988 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:54.316965 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" event={"ID":"32616bf4-ee78-4f72-b062-8497e3fee06d","Type":"ContainerStarted","Data":"7f02485174cc3526cbf93008b053a8e34863e019406699c26da68fab039eb4c5"} Jul 06 20:48:54.318422 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:54.318400 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2d92l" event={"ID":"67b2b0d4-1e54-408e-ae39-a626171fd87c","Type":"ContainerStarted","Data":"29eb6434bf24717da289fc144797ecc7bbc9f2a21629e57e9d577498615048c4"} Jul 06 20:48:54.319968 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:54.319946 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pzt4k" event={"ID":"37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381","Type":"ContainerStarted","Data":"7d914f2e5e8071d4be1b76b94904c1a591ca128e6c9bb53fb3bb352969975e43"} Jul 06 20:48:54.321554 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:54.321534 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qvt6g" event={"ID":"1d418585-bb7c-41bd-ac8f-56bfaf494254","Type":"ContainerStarted","Data":"39227de669cebd7a7109194e8c8c84eaad0f8e220e8478106af030102ec00533"} Jul 06 20:48:54.339496 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:54.339432 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" podStartSLOduration=14.339412294 podStartE2EDuration="14.339412294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:48:44.307387618 +0000 UTC m=+5.641204131" watchObservedRunningTime="2026-07-06 20:48:54.339412294 +0000 UTC m=+15.673228808" Jul 06 20:48:54.355490 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:54.355434 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qvt6g" podStartSLOduration=4.672362225 podStartE2EDuration="15.355410951s" totalImagesPullingTime="10.683048726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:48:54.355149089 +0000 UTC m=+15.688965606" watchObservedRunningTime="2026-07-06 20:48:54.355410951 +0000 UTC m=+15.689227464" Jul 06 20:48:54.373158 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:54.373100 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9lg84" podStartSLOduration=4.663461796 podStartE2EDuration="15.373068153s" totalImagesPullingTime="10.709606357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:48:54.372851105 +0000 UTC m=+15.706667618" watchObservedRunningTime="2026-07-06 20:48:54.373068153 +0000 UTC m=+15.706884664" Jul 06 20:48:54.388432 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:54.388377 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2d92l" podStartSLOduration=4.696656342 podStartE2EDuration="15.388359117s" totalImagesPullingTime="10.691702775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:48:54.388214392 +0000 UTC m=+15.722030906" watchObservedRunningTime="2026-07-06 20:48:54.388359117 +0000 UTC m=+15.722175630" Jul 06 20:48:54.405788 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:54.405722 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pzt4k" podStartSLOduration=4.708375625 podStartE2EDuration="15.405702033s" totalImagesPullingTime="10.697326408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:48:54.405503719 +0000 UTC m=+15.739320231" watchObservedRunningTime="2026-07-06 20:48:54.405702033 +0000 UTC m=+15.739518544" Jul 06 20:48:54.938713 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:54.938499 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qvt6g" Jul 06 20:48:55.207464 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:55.207373 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:55.207615 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:55.207373 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:48:55.207615 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:55.207513 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:48:55.207615 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:55.207552 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:55.207743 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:55.207645 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:48:55.207743 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:55.207733 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:48:55.251140 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:55.251090 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qvt6g" Jul 06 20:48:55.251745 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:55.251724 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qvt6g" Jul 06 20:48:55.325373 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:55.325323 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7wdzt" event={"ID":"1e83e41a-db4f-4835-b4e0-7d016601087d","Type":"ContainerStarted","Data":"f4ab3235e6c6edc1791befc7d3466094515d7f5f1eb11596e12c7118056dcecf"} Jul 06 20:48:55.326353 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:55.326330 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qvt6g" Jul 06 20:48:55.348336 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:55.348280 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7wdzt" podStartSLOduration=4.66113077 podStartE2EDuration="15.348264049s" totalImagesPullingTime="10.687133279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:48:55.34787314 +0000 UTC m=+16.681689652" watchObservedRunningTime="2026-07-06 20:48:55.348264049 +0000 UTC m=+16.682080560" Jul 06 20:48:56.878754 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:56.878720 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs\") pod \"network-metrics-daemon-f7qm4\" (UID: \"014fb632-7183-4ad8-a74e-838a8d162eef\") " pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:56.879231 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:56.878860 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:48:56.879231 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:56.878927 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs podName:014fb632-7183-4ad8-a74e-838a8d162eef nodeName:}" failed. No retries permitted until 2026-07-06 20:49:12.878913645 +0000 UTC m=+34.212730157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs") pod "network-metrics-daemon-f7qm4" (UID: "014fb632-7183-4ad8-a74e-838a8d162eef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:48:56.979667 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:56.979630 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret\") pod \"global-pull-secret-syncer-s4cpg\" (UID: \"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9\") " pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:56.979667 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:56.979678 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htc5b\" (UniqueName: \"kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b\") pod \"network-check-target-rp2sj\" (UID: \"a2ec5721-43da-420a-979e-8d87ce647c73\") " pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:48:56.979896 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:56.979785 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:48:56.979896 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:56.979856 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret podName:01a651e4-e3a5-4a70-870d-9ed3c9bfacb9 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:12.979840711 +0000 UTC m=+34.313657205 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret") pod "global-pull-secret-syncer-s4cpg" (UID: "01a651e4-e3a5-4a70-870d-9ed3c9bfacb9") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:48:56.979896 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:56.979791 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:48:56.980002 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:56.979906 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:48:56.980002 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:56.979919 2586 projected.go:196] Error preparing data for projected volume kube-api-access-htc5b for pod openshift-network-diagnostics/network-check-target-rp2sj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:48:56.980002 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:56.979959 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b podName:a2ec5721-43da-420a-979e-8d87ce647c73 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:12.979947431 +0000 UTC m=+34.313763920 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-htc5b" (UniqueName: "kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b") pod "network-check-target-rp2sj" (UID: "a2ec5721-43da-420a-979e-8d87ce647c73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:48:57.207590 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:57.207550 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:48:57.207590 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:57.207589 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:57.207866 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:57.207550 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:57.207866 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:57.207688 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:48:57.207866 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:57.207798 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:48:57.207994 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:57.207897 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:48:57.331043 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:57.331005 2586 generic.go:356] "Generic (PLEG): container finished" podID="305a40cd-a1ac-4b06-aa5f-c09c29459213" containerID="0ff9ea78a8c4abb7f74ed345cd07675c495d0321c078520c58828c1837f28654" exitCode=0 Jul 06 20:48:57.331043 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:57.331037 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwzh6" event={"ID":"305a40cd-a1ac-4b06-aa5f-c09c29459213","Type":"ContainerDied","Data":"0ff9ea78a8c4abb7f74ed345cd07675c495d0321c078520c58828c1837f28654"} Jul 06 20:48:59.208254 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:59.208213 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:48:59.209071 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:59.208308 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:48:59.209071 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:59.208321 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:48:59.209071 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:59.208438 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:48:59.209071 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:48:59.208493 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:48:59.209071 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:48:59.208558 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:49:01.208172 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:01.208129 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:49:01.208655 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:01.208140 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:49:01.208655 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:01.208282 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:49:01.208655 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:01.208140 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:49:01.208655 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:01.208352 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:49:01.208655 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:01.208424 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:49:01.852089 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:01.851893 2586 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 20:49:02.267654 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:02.267539 2586 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T20:49:01.852067294Z","UUID":"88aa5900-c645-4981-9996-a43808544988","Handler":null,"Name":"","Endpoint":""} Jul 06 20:49:02.269235 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:02.269214 2586 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 20:49:02.269364 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:02.269251 2586 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 20:49:02.342842 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:02.342709 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rkktm" event={"ID":"15d6af7f-a295-4b83-8a7e-71280841ca8a","Type":"ContainerStarted","Data":"bde97acb3095ea1dbdf80cd2af84ce3367ad43b989f617148d089cee642cdae5"} Jul 06 20:49:02.344795 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:02.344764 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" event={"ID":"32616bf4-ee78-4f72-b062-8497e3fee06d","Type":"ContainerStarted","Data":"33046040522a62fabc7e11bb50b1b41ca738d25da55f4d0202ddb216d67ffecd"} Jul 06 20:49:02.348201 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:02.348172 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" event={"ID":"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18","Type":"ContainerStarted","Data":"b176e66d3ddbc33b36da108d493920299524ae59f4a1c3e61c40127766b85f7e"} Jul 06 20:49:02.348320 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:02.348238 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" event={"ID":"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18","Type":"ContainerStarted","Data":"22eac6edbb43f7ce53c53b7cfe9efffde49f50075797e2c6abec641169c152ef"} Jul 06 20:49:02.348320 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:02.348276 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" event={"ID":"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18","Type":"ContainerStarted","Data":"45045987b4afd51f07866fef76c680b81804cec59e7c87493ef13fc4f7df2c11"} Jul 06 20:49:02.348320 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:02.348307 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" event={"ID":"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18","Type":"ContainerStarted","Data":"c081be63c8cf3dc98da6a38e8c8f8e4acb1641e34587fdc9f83c07e3ba97851f"} Jul 06 20:49:02.348444 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:02.348344 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" event={"ID":"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18","Type":"ContainerStarted","Data":"20b2c7adf33e21004c2a53747c926acc8e8b07711a1fe64d7c043f0ad970a517"} Jul 06 20:49:02.348444 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:02.348376 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" event={"ID":"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18","Type":"ContainerStarted","Data":"42fac3fe8e421242b732859356e6419ca7de789c7c616bd47c210c0620728249"} Jul 06 20:49:02.363588 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:02.363529 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rkktm" podStartSLOduration=4.280613208 podStartE2EDuration="23.363510161s" totalImagesPullingTime="19.082896953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:02.362809657 +0000 UTC m=+23.696626171" watchObservedRunningTime="2026-07-06 20:49:02.363510161 +0000 UTC m=+23.697326674" Jul 06 20:49:03.207706 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:03.207671 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:49:03.208043 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:03.207716 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:49:03.208043 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:03.207799 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:49:03.208043 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:03.207850 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:49:03.208043 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:03.207890 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:49:03.208043 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:03.207973 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:49:04.358460 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:04.358187 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" event={"ID":"32616bf4-ee78-4f72-b062-8497e3fee06d","Type":"ContainerStarted","Data":"316334b2f333258b1bade464382f528378ff859e5bacf708354373426589babb"} Jul 06 20:49:04.362058 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:04.361948 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" event={"ID":"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18","Type":"ContainerStarted","Data":"78836a6a2488d3fb68cd342e0af1df7928242ae7a4ab4408d4736f61afdb8c97"} Jul 06 20:49:04.379129 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:04.379061 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrwqv" podStartSLOduration=5.098094215 podStartE2EDuration="25.379043455s" totalImagesPullingTime="20.28094924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:04.379030277 +0000 UTC m=+25.712846790" watchObservedRunningTime="2026-07-06 20:49:04.379043455 +0000 UTC m=+25.712859961" Jul 06 20:49:05.208170 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:05.208133 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:49:05.208351 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:05.208134 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:49:05.208351 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:05.208261 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:49:05.208351 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:05.208134 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:49:05.208351 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:05.208324 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:49:05.208544 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:05.208428 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:49:07.208040 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:07.208002 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:49:07.208458 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:07.208002 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:49:07.208458 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:07.208132 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:49:07.208458 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:07.208215 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:49:07.208458 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:07.208002 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:49:07.208458 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:07.208322 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:49:07.374354 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:07.374169 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" event={"ID":"d32abe9d-5c42-41b8-aacf-0fdd0cf34c18","Type":"ContainerStarted","Data":"d3df07f007f6746b574780a1bca7c1a5a93c069d50d9ba9a3f852bb10f375c56"} Jul 06 20:49:07.374740 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:07.374486 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:49:07.374740 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:07.374560 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:49:07.374740 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:07.374603 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:49:07.391927 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:07.391722 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:49:07.391927 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:07.391849 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:49:07.406468 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:07.406418 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" podStartSLOduration=8.126830317 podStartE2EDuration="28.406402752s" totalImagesPullingTime="20.279572435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:07.405982238 +0000 UTC m=+28.739798750" watchObservedRunningTime="2026-07-06 20:49:07.406402752 +0000 UTC m=+28.740219263" Jul 06 20:49:08.378223 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:08.378016 2586 generic.go:356] "Generic (PLEG): container finished" podID="305a40cd-a1ac-4b06-aa5f-c09c29459213" containerID="b6ee812ba4be1b3e2f9ccd553ce36e7042fbfb03e29022222c73a9503ef88788" exitCode=0 Jul 06 20:49:08.379170 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:08.378101 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwzh6" event={"ID":"305a40cd-a1ac-4b06-aa5f-c09c29459213","Type":"ContainerDied","Data":"b6ee812ba4be1b3e2f9ccd553ce36e7042fbfb03e29022222c73a9503ef88788"} Jul 06 20:49:09.209442 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:09.209114 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:49:09.209442 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:09.209223 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:49:09.209442 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:09.209314 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:49:09.209442 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:09.209219 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:49:09.209442 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:09.209387 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:49:09.209442 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:09.209396 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:49:09.842849 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:09.842763 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s4cpg"] Jul 06 20:49:09.843309 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:09.842892 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:49:09.843309 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:09.843006 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:49:09.847216 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:09.847193 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rp2sj"] Jul 06 20:49:09.847322 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:09.847289 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:49:09.847377 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:09.847360 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:49:09.850682 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:09.850659 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f7qm4"] Jul 06 20:49:09.850799 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:09.850778 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:49:09.850906 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:09.850887 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:49:10.384619 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:10.384582 2586 generic.go:356] "Generic (PLEG): container finished" podID="305a40cd-a1ac-4b06-aa5f-c09c29459213" containerID="9a9bf55b4b26f5647607d892f9c732b12a2c11c0c08512e172f6e95d1ef5f913" exitCode=0 Jul 06 20:49:10.384812 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:10.384634 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwzh6" event={"ID":"305a40cd-a1ac-4b06-aa5f-c09c29459213","Type":"ContainerDied","Data":"9a9bf55b4b26f5647607d892f9c732b12a2c11c0c08512e172f6e95d1ef5f913"} Jul 06 20:49:11.207951 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:11.207918 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:49:11.208432 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:11.208041 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:49:11.208432 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:11.208130 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:49:11.208432 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:11.208130 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:49:12.207826 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:12.207791 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:49:12.207997 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:12.207892 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:49:12.391432 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:12.391397 2586 generic.go:356] "Generic (PLEG): container finished" podID="305a40cd-a1ac-4b06-aa5f-c09c29459213" containerID="aa46aadf6f562d04da9d1992446a6394b439a50a3561bd76ab661cfec959c410" exitCode=0 Jul 06 20:49:12.391594 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:12.391456 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwzh6" event={"ID":"305a40cd-a1ac-4b06-aa5f-c09c29459213","Type":"ContainerDied","Data":"aa46aadf6f562d04da9d1992446a6394b439a50a3561bd76ab661cfec959c410"} Jul 06 20:49:12.901960 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:12.901725 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs\") pod \"network-metrics-daemon-f7qm4\" (UID: \"014fb632-7183-4ad8-a74e-838a8d162eef\") " pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:49:12.902167 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:12.901894 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:49:12.902167 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:12.902102 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs podName:014fb632-7183-4ad8-a74e-838a8d162eef nodeName:}" failed. No retries permitted until 2026-07-06 20:49:44.90206158 +0000 UTC m=+66.235878085 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs") pod "network-metrics-daemon-f7qm4" (UID: "014fb632-7183-4ad8-a74e-838a8d162eef") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:49:13.002997 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:13.002954 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htc5b\" (UniqueName: \"kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b\") pod \"network-check-target-rp2sj\" (UID: \"a2ec5721-43da-420a-979e-8d87ce647c73\") " pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:49:13.003204 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:13.003047 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret\") pod \"global-pull-secret-syncer-s4cpg\" (UID: \"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9\") " pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:49:13.003204 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:13.003150 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:49:13.003204 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:13.003172 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:49:13.003204 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:13.003170 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:49:13.003204 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:13.003187 2586 projected.go:196] Error preparing data for projected volume kube-api-access-htc5b for pod openshift-network-diagnostics/network-check-target-rp2sj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:49:13.003454 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:13.003239 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret podName:01a651e4-e3a5-4a70-870d-9ed3c9bfacb9 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:45.00322037 +0000 UTC m=+66.337036864 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret") pod "global-pull-secret-syncer-s4cpg" (UID: "01a651e4-e3a5-4a70-870d-9ed3c9bfacb9") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:49:13.003454 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:13.003259 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b podName:a2ec5721-43da-420a-979e-8d87ce647c73 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:45.00325044 +0000 UTC m=+66.337066930 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-htc5b" (UniqueName: "kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b") pod "network-check-target-rp2sj" (UID: "a2ec5721-43da-420a-979e-8d87ce647c73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:49:13.207431 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:13.207397 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:49:13.207636 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:13.207523 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4cpg" podUID="01a651e4-e3a5-4a70-870d-9ed3c9bfacb9" Jul 06 20:49:13.207636 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:13.207579 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:49:13.207765 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:13.207706 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7qm4" podUID="014fb632-7183-4ad8-a74e-838a8d162eef" Jul 06 20:49:14.207332 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.207297 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:49:14.207751 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:14.207405 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rp2sj" podUID="a2ec5721-43da-420a-979e-8d87ce647c73" Jul 06 20:49:14.400337 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.400262 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeReady" Jul 06 20:49:14.400487 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.400384 2586 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 20:49:14.442775 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.442738 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59f6cb6fc6-x4p42"] Jul 06 20:49:14.446891 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.446872 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.449912 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.449884 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 20:49:14.450035 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.449888 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 20:49:14.450591 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.450568 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f4d5n\"" Jul 06 20:49:14.450591 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.450589 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 20:49:14.459140 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.459108 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 20:49:14.461570 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.461543 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dtxbd"] Jul 06 20:49:14.465589 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.465567 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59f6cb6fc6-x4p42"] Jul 06 20:49:14.465701 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.465660 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:14.468669 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.468637 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8q9dq\"" Jul 06 20:49:14.469034 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.469012 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 20:49:14.469163 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.469051 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 20:49:14.469594 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.469568 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xg26k"] Jul 06 20:49:14.473866 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.473835 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xg26k" Jul 06 20:49:14.476592 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.476571 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8v6gc\"" Jul 06 20:49:14.476706 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.476616 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 20:49:14.476706 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.476571 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 20:49:14.476866 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.476805 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 20:49:14.478650 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.478627 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dtxbd"] Jul 06 20:49:14.485492 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.485289 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xg26k"] Jul 06 20:49:14.615177 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.615140 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9pjc\" (UniqueName: \"kubernetes.io/projected/5f9dfb85-aa70-4443-9923-09a46f9bdffb-kube-api-access-h9pjc\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:14.615356 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.615234 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ffde4f3-2adc-4563-a038-14e2232607f8-trusted-ca\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.615356 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.615273 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0ffde4f3-2adc-4563-a038-14e2232607f8-installation-pull-secrets\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.615356 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.615306 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-bound-sa-token\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.615356 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.615347 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0ffde4f3-2adc-4563-a038-14e2232607f8-ca-trust-extracted\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.615548 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.615371 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:14.615548 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.615455 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.615548 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.615482 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f9dfb85-aa70-4443-9923-09a46f9bdffb-tmp-dir\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:14.615548 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.615505 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13f352df-013d-46cf-9b1e-ef80acc6b127-cert\") pod \"ingress-canary-xg26k\" (UID: \"13f352df-013d-46cf-9b1e-ef80acc6b127\") " pod="openshift-ingress-canary/ingress-canary-xg26k" Jul 06 20:49:14.615548 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.615534 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0ffde4f3-2adc-4563-a038-14e2232607f8-image-registry-private-configuration\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.615744 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.615560 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-certificates\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.615744 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.615621 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctqc6\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-kube-api-access-ctqc6\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.615744 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.615661 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2thff\" (UniqueName: \"kubernetes.io/projected/13f352df-013d-46cf-9b1e-ef80acc6b127-kube-api-access-2thff\") pod \"ingress-canary-xg26k\" (UID: \"13f352df-013d-46cf-9b1e-ef80acc6b127\") " pod="openshift-ingress-canary/ingress-canary-xg26k" Jul 06 20:49:14.615744 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.615690 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f9dfb85-aa70-4443-9923-09a46f9bdffb-config-volume\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:14.716541 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.716497 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9pjc\" (UniqueName: \"kubernetes.io/projected/5f9dfb85-aa70-4443-9923-09a46f9bdffb-kube-api-access-h9pjc\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:14.716541 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.716541 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ffde4f3-2adc-4563-a038-14e2232607f8-trusted-ca\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.716758 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.716558 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0ffde4f3-2adc-4563-a038-14e2232607f8-installation-pull-secrets\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.716758 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.716688 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-bound-sa-token\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.716758 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.716746 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0ffde4f3-2adc-4563-a038-14e2232607f8-ca-trust-extracted\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.716895 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.716780 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:14.716895 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.716847 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.716895 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.716869 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f9dfb85-aa70-4443-9923-09a46f9bdffb-tmp-dir\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:14.717039 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.716907 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13f352df-013d-46cf-9b1e-ef80acc6b127-cert\") pod \"ingress-canary-xg26k\" (UID: \"13f352df-013d-46cf-9b1e-ef80acc6b127\") " pod="openshift-ingress-canary/ingress-canary-xg26k" Jul 06 20:49:14.717039 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.716953 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0ffde4f3-2adc-4563-a038-14e2232607f8-image-registry-private-configuration\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.717039 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:14.716961 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:49:14.717039 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:14.716977 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f6cb6fc6-x4p42: secret "image-registry-tls" not found Jul 06 20:49:14.717039 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.716981 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-certificates\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.717039 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:14.716989 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:49:14.717039 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:14.717029 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls podName:0ffde4f3-2adc-4563-a038-14e2232607f8 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:15.217009684 +0000 UTC m=+36.550826183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls") pod "image-registry-59f6cb6fc6-x4p42" (UID: "0ffde4f3-2adc-4563-a038-14e2232607f8") : secret "image-registry-tls" not found Jul 06 20:49:14.717485 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:14.717056 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls podName:5f9dfb85-aa70-4443-9923-09a46f9bdffb nodeName:}" failed. No retries permitted until 2026-07-06 20:49:15.21703708 +0000 UTC m=+36.550853583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls") pod "dns-default-dtxbd" (UID: "5f9dfb85-aa70-4443-9923-09a46f9bdffb") : secret "dns-default-metrics-tls" not found Jul 06 20:49:14.717485 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.717097 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctqc6\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-kube-api-access-ctqc6\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.717485 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.717129 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2thff\" (UniqueName: \"kubernetes.io/projected/13f352df-013d-46cf-9b1e-ef80acc6b127-kube-api-access-2thff\") pod \"ingress-canary-xg26k\" (UID: \"13f352df-013d-46cf-9b1e-ef80acc6b127\") " pod="openshift-ingress-canary/ingress-canary-xg26k" Jul 06 20:49:14.717485 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.717156 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f9dfb85-aa70-4443-9923-09a46f9bdffb-config-volume\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:14.717485 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.717191 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0ffde4f3-2adc-4563-a038-14e2232607f8-ca-trust-extracted\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.717485 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.717299 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f9dfb85-aa70-4443-9923-09a46f9bdffb-tmp-dir\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:14.717786 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.717695 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ffde4f3-2adc-4563-a038-14e2232607f8-trusted-ca\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.717786 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.717703 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f9dfb85-aa70-4443-9923-09a46f9bdffb-config-volume\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:14.717786 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.717708 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-certificates\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.720895 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.720875 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0ffde4f3-2adc-4563-a038-14e2232607f8-installation-pull-secrets\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.720981 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.720926 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13f352df-013d-46cf-9b1e-ef80acc6b127-cert\") pod \"ingress-canary-xg26k\" (UID: \"13f352df-013d-46cf-9b1e-ef80acc6b127\") " pod="openshift-ingress-canary/ingress-canary-xg26k" Jul 06 20:49:14.720981 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.720929 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0ffde4f3-2adc-4563-a038-14e2232607f8-image-registry-private-configuration\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.729587 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.729553 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9pjc\" (UniqueName: \"kubernetes.io/projected/5f9dfb85-aa70-4443-9923-09a46f9bdffb-kube-api-access-h9pjc\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:14.729707 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.729687 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-bound-sa-token\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.730520 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.730494 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2thff\" (UniqueName: \"kubernetes.io/projected/13f352df-013d-46cf-9b1e-ef80acc6b127-kube-api-access-2thff\") pod \"ingress-canary-xg26k\" (UID: \"13f352df-013d-46cf-9b1e-ef80acc6b127\") " pod="openshift-ingress-canary/ingress-canary-xg26k" Jul 06 20:49:14.733623 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.733600 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctqc6\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-kube-api-access-ctqc6\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:14.786490 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.786441 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xg26k" Jul 06 20:49:14.930148 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:14.930113 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xg26k"] Jul 06 20:49:14.934692 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:49:14.934665 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f352df_013d_46cf_9b1e_ef80acc6b127.slice/crio-baef373a2c27d9262f90b51065e9d4a5e1193c25930b5d94c9721110fd50187a WatchSource:0}: Error finding container baef373a2c27d9262f90b51065e9d4a5e1193c25930b5d94c9721110fd50187a: Status 404 returned error can't find the container with id baef373a2c27d9262f90b51065e9d4a5e1193c25930b5d94c9721110fd50187a Jul 06 20:49:15.208196 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:15.208166 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:49:15.209062 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:15.208175 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:49:15.216466 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:15.216439 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:49:15.216597 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:15.216439 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-njzmz\"" Jul 06 20:49:15.216597 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:15.216486 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:49:15.220546 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:15.220525 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:15.220664 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:15.220588 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:15.220726 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:15.220683 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:49:15.220777 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:15.220734 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:49:15.220777 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:15.220749 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f6cb6fc6-x4p42: secret "image-registry-tls" not found Jul 06 20:49:15.220777 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:15.220767 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls podName:5f9dfb85-aa70-4443-9923-09a46f9bdffb nodeName:}" failed. No retries permitted until 2026-07-06 20:49:16.22074564 +0000 UTC m=+37.554562148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls") pod "dns-default-dtxbd" (UID: "5f9dfb85-aa70-4443-9923-09a46f9bdffb") : secret "dns-default-metrics-tls" not found Jul 06 20:49:15.220895 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:15.220797 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls podName:0ffde4f3-2adc-4563-a038-14e2232607f8 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:16.220779794 +0000 UTC m=+37.554596295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls") pod "image-registry-59f6cb6fc6-x4p42" (UID: "0ffde4f3-2adc-4563-a038-14e2232607f8") : secret "image-registry-tls" not found Jul 06 20:49:15.399415 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:15.399386 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xg26k" event={"ID":"13f352df-013d-46cf-9b1e-ef80acc6b127","Type":"ContainerStarted","Data":"baef373a2c27d9262f90b51065e9d4a5e1193c25930b5d94c9721110fd50187a"} Jul 06 20:49:16.207726 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:16.207544 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:49:16.210746 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:16.210718 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qzqlr\"" Jul 06 20:49:16.211156 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:16.210718 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:49:16.211156 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:16.210727 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:49:16.226923 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:16.226889 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:16.227109 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:16.226956 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:16.227109 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:16.227053 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:49:16.227109 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:16.227096 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:49:16.227109 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:16.227108 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f6cb6fc6-x4p42: secret "image-registry-tls" not found Jul 06 20:49:16.227328 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:16.227133 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls podName:5f9dfb85-aa70-4443-9923-09a46f9bdffb nodeName:}" failed. No retries permitted until 2026-07-06 20:49:18.227114146 +0000 UTC m=+39.560930657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls") pod "dns-default-dtxbd" (UID: "5f9dfb85-aa70-4443-9923-09a46f9bdffb") : secret "dns-default-metrics-tls" not found Jul 06 20:49:16.227328 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:16.227151 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls podName:0ffde4f3-2adc-4563-a038-14e2232607f8 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:18.227141923 +0000 UTC m=+39.560958420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls") pod "image-registry-59f6cb6fc6-x4p42" (UID: "0ffde4f3-2adc-4563-a038-14e2232607f8") : secret "image-registry-tls" not found Jul 06 20:49:18.242951 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:18.242907 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:18.243422 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:18.242983 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:18.243422 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:18.243096 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:49:18.243422 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:18.243167 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:49:18.243422 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:18.243178 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls podName:5f9dfb85-aa70-4443-9923-09a46f9bdffb nodeName:}" failed. No retries permitted until 2026-07-06 20:49:22.243159055 +0000 UTC m=+43.576975545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls") pod "dns-default-dtxbd" (UID: "5f9dfb85-aa70-4443-9923-09a46f9bdffb") : secret "dns-default-metrics-tls" not found Jul 06 20:49:18.243422 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:18.243189 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f6cb6fc6-x4p42: secret "image-registry-tls" not found Jul 06 20:49:18.243422 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:18.243247 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls podName:0ffde4f3-2adc-4563-a038-14e2232607f8 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:22.243228761 +0000 UTC m=+43.577045265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls") pod "image-registry-59f6cb6fc6-x4p42" (UID: "0ffde4f3-2adc-4563-a038-14e2232607f8") : secret "image-registry-tls" not found Jul 06 20:49:19.411778 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:19.411742 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xg26k" event={"ID":"13f352df-013d-46cf-9b1e-ef80acc6b127","Type":"ContainerStarted","Data":"9ab321688cb73db4da3620df07048c3eb3c1e599dc347446ca8583a0c0307d00"} Jul 06 20:49:19.414607 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:19.414584 2586 generic.go:356] "Generic (PLEG): container finished" podID="305a40cd-a1ac-4b06-aa5f-c09c29459213" containerID="28b6f8c1261ea5678a93fe953a4c2ee38ebb799e72fabd050959181a31516d4f" exitCode=0 Jul 06 20:49:19.414733 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:19.414624 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwzh6" event={"ID":"305a40cd-a1ac-4b06-aa5f-c09c29459213","Type":"ContainerDied","Data":"28b6f8c1261ea5678a93fe953a4c2ee38ebb799e72fabd050959181a31516d4f"} Jul 06 20:49:19.431626 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:19.431577 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xg26k" podStartSLOduration=1.393373129 podStartE2EDuration="5.431560932s" totalImagesPullingTime="4.038187803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:19.431009773 +0000 UTC m=+40.764826284" watchObservedRunningTime="2026-07-06 20:49:19.431560932 +0000 UTC m=+40.765377443" Jul 06 20:49:20.419665 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:20.419633 2586 generic.go:356] "Generic (PLEG): container finished" podID="305a40cd-a1ac-4b06-aa5f-c09c29459213" containerID="8dde71b9547e59b51dde3694f165d50263df31e8574bb89c7edbdeff5a3f2ec6" exitCode=0 Jul 06 20:49:20.420113 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:20.419707 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwzh6" event={"ID":"305a40cd-a1ac-4b06-aa5f-c09c29459213","Type":"ContainerDied","Data":"8dde71b9547e59b51dde3694f165d50263df31e8574bb89c7edbdeff5a3f2ec6"} Jul 06 20:49:21.425187 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:21.424990 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwzh6" event={"ID":"305a40cd-a1ac-4b06-aa5f-c09c29459213","Type":"ContainerStarted","Data":"0a24aa88c67f8ff66702bebf4e1eb885bc4d35c3d4582925c7422159e1b8bf79"} Jul 06 20:49:21.457956 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:21.457906 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nwzh6" podStartSLOduration=13.00985266 podStartE2EDuration="42.457889922s" totalImagesPullingTime="29.448037262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:21.456178596 +0000 UTC m=+42.789995109" watchObservedRunningTime="2026-07-06 20:49:21.457889922 +0000 UTC m=+42.791706433" Jul 06 20:49:22.271357 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:22.270940 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:22.271357 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:22.271050 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:22.271357 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:22.271252 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:49:22.271357 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:22.271275 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f6cb6fc6-x4p42: secret "image-registry-tls" not found Jul 06 20:49:22.271357 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:22.271287 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:49:22.271357 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:22.271345 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls podName:0ffde4f3-2adc-4563-a038-14e2232607f8 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:30.271326039 +0000 UTC m=+51.605142550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls") pod "image-registry-59f6cb6fc6-x4p42" (UID: "0ffde4f3-2adc-4563-a038-14e2232607f8") : secret "image-registry-tls" not found Jul 06 20:49:22.271357 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:22.271363 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls podName:5f9dfb85-aa70-4443-9923-09a46f9bdffb nodeName:}" failed. No retries permitted until 2026-07-06 20:49:30.271353875 +0000 UTC m=+51.605170365 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls") pod "dns-default-dtxbd" (UID: "5f9dfb85-aa70-4443-9923-09a46f9bdffb") : secret "dns-default-metrics-tls" not found Jul 06 20:49:30.328755 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:30.328711 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:30.329325 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:30.328777 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:30.329325 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:30.328864 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:49:30.329325 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:30.328895 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:49:30.329325 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:30.328908 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f6cb6fc6-x4p42: secret "image-registry-tls" not found Jul 06 20:49:30.329325 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:30.328943 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls podName:5f9dfb85-aa70-4443-9923-09a46f9bdffb nodeName:}" failed. No retries permitted until 2026-07-06 20:49:46.328926445 +0000 UTC m=+67.662742940 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls") pod "dns-default-dtxbd" (UID: "5f9dfb85-aa70-4443-9923-09a46f9bdffb") : secret "dns-default-metrics-tls" not found Jul 06 20:49:30.329325 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:30.328958 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls podName:0ffde4f3-2adc-4563-a038-14e2232607f8 nodeName:}" failed. No retries permitted until 2026-07-06 20:49:46.328952373 +0000 UTC m=+67.662768862 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls") pod "image-registry-59f6cb6fc6-x4p42" (UID: "0ffde4f3-2adc-4563-a038-14e2232607f8") : secret "image-registry-tls" not found Jul 06 20:49:39.391157 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:39.391129 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gl8x4" Jul 06 20:49:44.943053 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:44.943011 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs\") pod \"network-metrics-daemon-f7qm4\" (UID: \"014fb632-7183-4ad8-a74e-838a8d162eef\") " pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:49:44.946016 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:44.945996 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:49:44.953219 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:44.953194 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 20:49:44.953328 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:44.953289 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs podName:014fb632-7183-4ad8-a74e-838a8d162eef nodeName:}" failed. No retries permitted until 2026-07-06 20:50:48.953266834 +0000 UTC m=+130.287083323 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs") pod "network-metrics-daemon-f7qm4" (UID: "014fb632-7183-4ad8-a74e-838a8d162eef") : secret "metrics-daemon-secret" not found Jul 06 20:49:45.043549 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:45.043512 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret\") pod \"global-pull-secret-syncer-s4cpg\" (UID: \"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9\") " pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:49:45.043549 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:45.043554 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htc5b\" (UniqueName: \"kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b\") pod \"network-check-target-rp2sj\" (UID: \"a2ec5721-43da-420a-979e-8d87ce647c73\") " pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:49:45.046704 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:45.046681 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:49:45.046825 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:45.046704 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:49:45.056952 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:45.056923 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:49:45.058195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:45.058176 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a651e4-e3a5-4a70-870d-9ed3c9bfacb9-original-pull-secret\") pod \"global-pull-secret-syncer-s4cpg\" (UID: \"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9\") " pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:49:45.084968 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:45.084932 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htc5b\" (UniqueName: \"kubernetes.io/projected/a2ec5721-43da-420a-979e-8d87ce647c73-kube-api-access-htc5b\") pod \"network-check-target-rp2sj\" (UID: \"a2ec5721-43da-420a-979e-8d87ce647c73\") " pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:49:45.218423 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:45.218343 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4cpg" Jul 06 20:49:45.323015 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:45.322991 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qzqlr\"" Jul 06 20:49:45.330482 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:45.330456 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:49:45.341147 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:45.341067 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s4cpg"] Jul 06 20:49:45.455662 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:45.455629 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rp2sj"] Jul 06 20:49:45.458934 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:49:45.458906 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ec5721_43da_420a_979e_8d87ce647c73.slice/crio-8be030009e40a7002f61d14175bd20ffd4ae93ce1ff9f81b9c3bd98eb62170d1 WatchSource:0}: Error finding container 8be030009e40a7002f61d14175bd20ffd4ae93ce1ff9f81b9c3bd98eb62170d1: Status 404 returned error can't find the container with id 8be030009e40a7002f61d14175bd20ffd4ae93ce1ff9f81b9c3bd98eb62170d1 Jul 06 20:49:45.481749 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:45.481673 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rp2sj" event={"ID":"a2ec5721-43da-420a-979e-8d87ce647c73","Type":"ContainerStarted","Data":"8be030009e40a7002f61d14175bd20ffd4ae93ce1ff9f81b9c3bd98eb62170d1"} Jul 06 20:49:45.482697 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:45.482678 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s4cpg" event={"ID":"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9","Type":"ContainerStarted","Data":"10aeb73398c56ca891fa4f6cf9009f593ac80eadcd84b59dcb7b541847d6ce07"} Jul 06 20:49:46.353891 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:46.353846 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:49:46.354389 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:46.353917 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:49:46.354389 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:46.354051 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:49:46.354389 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:46.354105 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:49:46.354389 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:46.354121 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f6cb6fc6-x4p42: secret "image-registry-tls" not found Jul 06 20:49:46.354389 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:46.354154 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls podName:5f9dfb85-aa70-4443-9923-09a46f9bdffb nodeName:}" failed. No retries permitted until 2026-07-06 20:50:18.354133433 +0000 UTC m=+99.687949925 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls") pod "dns-default-dtxbd" (UID: "5f9dfb85-aa70-4443-9923-09a46f9bdffb") : secret "dns-default-metrics-tls" not found Jul 06 20:49:46.354389 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:46.354176 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls podName:0ffde4f3-2adc-4563-a038-14e2232607f8 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:18.354166898 +0000 UTC m=+99.687983394 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls") pod "image-registry-59f6cb6fc6-x4p42" (UID: "0ffde4f3-2adc-4563-a038-14e2232607f8") : secret "image-registry-tls" not found Jul 06 20:49:50.497296 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:50.497252 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rp2sj" event={"ID":"a2ec5721-43da-420a-979e-8d87ce647c73","Type":"ContainerStarted","Data":"36c1396f53902056c772e5fbe55834c808d796b7fb656fe329b4b3adaa239ec0"} Jul 06 20:49:50.497801 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:50.497373 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:49:50.498809 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:50.498788 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s4cpg" event={"ID":"01a651e4-e3a5-4a70-870d-9ed3c9bfacb9","Type":"ContainerStarted","Data":"b4b4fb43751c75963f4e6e93b2f48082fb7deed561ad20c2629d380d65c8b1a2"} Jul 06 20:49:50.515207 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:50.515162 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rp2sj" podStartSLOduration=66.945401037 podStartE2EDuration="1m11.515146356s" totalImagesPullingTime="4.569745319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:50.51487275 +0000 UTC m=+71.848689263" watchObservedRunningTime="2026-07-06 20:49:50.515146356 +0000 UTC m=+71.848962868" Jul 06 20:49:50.530066 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:50.530011 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s4cpg" podStartSLOduration=65.842924031 podStartE2EDuration="1m10.5299951s" totalImagesPullingTime="4.687071069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:50.529767194 +0000 UTC m=+71.863583707" watchObservedRunningTime="2026-07-06 20:49:50.5299951 +0000 UTC m=+71.863811608" Jul 06 20:49:58.844069 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.844028 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94"] Jul 06 20:49:58.846803 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.846781 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf"] Jul 06 20:49:58.846917 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.846903 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94" Jul 06 20:49:58.848475 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.848454 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf" Jul 06 20:49:58.851678 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.851657 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-r74hp\"" Jul 06 20:49:58.851804 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.851661 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 20:49:58.851918 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.851904 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 20:49:58.854601 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.854388 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 20:49:58.854601 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.854482 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:49:58.854601 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.854487 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 20:49:58.854601 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.854497 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qmwc7\"" Jul 06 20:49:58.854601 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.854555 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:49:58.854601 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.854613 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 20:49:58.862327 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.862303 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf"] Jul 06 20:49:58.863048 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.863029 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94"] Jul 06 20:49:58.935815 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.935781 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-fxmcj"] Jul 06 20:49:58.937520 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.937503 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:49:58.940872 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.940850 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 20:49:58.941010 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.940850 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:49:58.941010 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.940850 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8pl2l\"" Jul 06 20:49:58.941010 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.940982 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 20:49:58.941692 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.941676 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 20:49:58.946526 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.946468 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14e83e77-682c-4ed5-b8d9-d4bc425c5b26-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8v94\" (UID: \"14e83e77-682c-4ed5-b8d9-d4bc425c5b26\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94" Jul 06 20:49:58.946626 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.946568 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4h9w\" (UniqueName: \"kubernetes.io/projected/14e83e77-682c-4ed5-b8d9-d4bc425c5b26-kube-api-access-g4h9w\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8v94\" (UID: \"14e83e77-682c-4ed5-b8d9-d4bc425c5b26\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94" Jul 06 20:49:58.946688 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.946651 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/14e83e77-682c-4ed5-b8d9-d4bc425c5b26-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8v94\" (UID: \"14e83e77-682c-4ed5-b8d9-d4bc425c5b26\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94" Jul 06 20:49:58.946688 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.946679 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-sblqf\" (UID: \"194a28e3-35af-4241-9e8e-49de37b200dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf" Jul 06 20:49:58.946784 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.946715 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pqsj\" (UniqueName: \"kubernetes.io/projected/194a28e3-35af-4241-9e8e-49de37b200dc-kube-api-access-9pqsj\") pod \"cluster-samples-operator-56fcf86bf-sblqf\" (UID: \"194a28e3-35af-4241-9e8e-49de37b200dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf" Jul 06 20:49:58.950137 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.950113 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 20:49:58.953242 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:58.953223 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-fxmcj"] Jul 06 20:49:59.047881 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.047846 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ec4b5d3-3779-4781-809d-da31fe3a5c6c-config\") pod \"console-operator-68b757fb67-fxmcj\" (UID: \"5ec4b5d3-3779-4781-809d-da31fe3a5c6c\") " pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:49:59.047881 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.047883 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77nr2\" (UniqueName: \"kubernetes.io/projected/5ec4b5d3-3779-4781-809d-da31fe3a5c6c-kube-api-access-77nr2\") pod \"console-operator-68b757fb67-fxmcj\" (UID: \"5ec4b5d3-3779-4781-809d-da31fe3a5c6c\") " pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:49:59.048118 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.047979 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14e83e77-682c-4ed5-b8d9-d4bc425c5b26-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8v94\" (UID: \"14e83e77-682c-4ed5-b8d9-d4bc425c5b26\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94" Jul 06 20:49:59.048118 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.048010 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4h9w\" (UniqueName: \"kubernetes.io/projected/14e83e77-682c-4ed5-b8d9-d4bc425c5b26-kube-api-access-g4h9w\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8v94\" (UID: \"14e83e77-682c-4ed5-b8d9-d4bc425c5b26\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94" Jul 06 20:49:59.048118 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.048050 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/14e83e77-682c-4ed5-b8d9-d4bc425c5b26-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8v94\" (UID: \"14e83e77-682c-4ed5-b8d9-d4bc425c5b26\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94" Jul 06 20:49:59.048220 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.048194 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-sblqf\" (UID: \"194a28e3-35af-4241-9e8e-49de37b200dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf" Jul 06 20:49:59.048255 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.048230 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pqsj\" (UniqueName: \"kubernetes.io/projected/194a28e3-35af-4241-9e8e-49de37b200dc-kube-api-access-9pqsj\") pod \"cluster-samples-operator-56fcf86bf-sblqf\" (UID: \"194a28e3-35af-4241-9e8e-49de37b200dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf" Jul 06 20:49:59.048303 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.048262 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ec4b5d3-3779-4781-809d-da31fe3a5c6c-trusted-ca\") pod \"console-operator-68b757fb67-fxmcj\" (UID: \"5ec4b5d3-3779-4781-809d-da31fe3a5c6c\") " pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:49:59.048303 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.048292 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5ec4b5d3-3779-4781-809d-da31fe3a5c6c-serving-cert\") pod \"console-operator-68b757fb67-fxmcj\" (UID: \"5ec4b5d3-3779-4781-809d-da31fe3a5c6c\") " pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:49:59.048408 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:59.048364 2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 20:49:59.048465 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:59.048451 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls podName:194a28e3-35af-4241-9e8e-49de37b200dc nodeName:}" failed. No retries permitted until 2026-07-06 20:49:59.54842988 +0000 UTC m=+80.882246391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-sblqf" (UID: "194a28e3-35af-4241-9e8e-49de37b200dc") : secret "samples-operator-tls" not found Jul 06 20:49:59.048649 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.048629 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14e83e77-682c-4ed5-b8d9-d4bc425c5b26-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8v94\" (UID: \"14e83e77-682c-4ed5-b8d9-d4bc425c5b26\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94" Jul 06 20:49:59.050203 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.050187 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/14e83e77-682c-4ed5-b8d9-d4bc425c5b26-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8v94\" (UID: \"14e83e77-682c-4ed5-b8d9-d4bc425c5b26\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94" Jul 06 20:49:59.056590 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.056569 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4h9w\" (UniqueName: \"kubernetes.io/projected/14e83e77-682c-4ed5-b8d9-d4bc425c5b26-kube-api-access-g4h9w\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8v94\" (UID: \"14e83e77-682c-4ed5-b8d9-d4bc425c5b26\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94" Jul 06 20:49:59.056828 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.056810 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pqsj\" (UniqueName: \"kubernetes.io/projected/194a28e3-35af-4241-9e8e-49de37b200dc-kube-api-access-9pqsj\") pod \"cluster-samples-operator-56fcf86bf-sblqf\" (UID: \"194a28e3-35af-4241-9e8e-49de37b200dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf" Jul 06 20:49:59.149305 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.149209 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ec4b5d3-3779-4781-809d-da31fe3a5c6c-trusted-ca\") pod \"console-operator-68b757fb67-fxmcj\" (UID: \"5ec4b5d3-3779-4781-809d-da31fe3a5c6c\") " pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:49:59.149305 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.149249 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5ec4b5d3-3779-4781-809d-da31fe3a5c6c-serving-cert\") pod \"console-operator-68b757fb67-fxmcj\" (UID: \"5ec4b5d3-3779-4781-809d-da31fe3a5c6c\") " pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:49:59.149305 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.149293 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ec4b5d3-3779-4781-809d-da31fe3a5c6c-config\") pod \"console-operator-68b757fb67-fxmcj\" (UID: \"5ec4b5d3-3779-4781-809d-da31fe3a5c6c\") " pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:49:59.149578 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.149410 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77nr2\" (UniqueName: \"kubernetes.io/projected/5ec4b5d3-3779-4781-809d-da31fe3a5c6c-kube-api-access-77nr2\") pod \"console-operator-68b757fb67-fxmcj\" (UID: \"5ec4b5d3-3779-4781-809d-da31fe3a5c6c\") " pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:49:59.150146 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.150122 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ec4b5d3-3779-4781-809d-da31fe3a5c6c-config\") pod \"console-operator-68b757fb67-fxmcj\" (UID: \"5ec4b5d3-3779-4781-809d-da31fe3a5c6c\") " pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:49:59.150263 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.150248 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ec4b5d3-3779-4781-809d-da31fe3a5c6c-trusted-ca\") pod \"console-operator-68b757fb67-fxmcj\" (UID: \"5ec4b5d3-3779-4781-809d-da31fe3a5c6c\") " pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:49:59.151686 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.151665 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5ec4b5d3-3779-4781-809d-da31fe3a5c6c-serving-cert\") pod \"console-operator-68b757fb67-fxmcj\" (UID: \"5ec4b5d3-3779-4781-809d-da31fe3a5c6c\") " pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:49:59.156507 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.156492 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94" Jul 06 20:49:59.158163 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.158146 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77nr2\" (UniqueName: \"kubernetes.io/projected/5ec4b5d3-3779-4781-809d-da31fe3a5c6c-kube-api-access-77nr2\") pod \"console-operator-68b757fb67-fxmcj\" (UID: \"5ec4b5d3-3779-4781-809d-da31fe3a5c6c\") " pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:49:59.247461 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.247426 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:49:59.281821 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.281792 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94"] Jul 06 20:49:59.284997 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:49:59.284971 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14e83e77_682c_4ed5_b8d9_d4bc425c5b26.slice/crio-5bc5d6c8dbd8c5ba1d63d4fc4a82de47aba57deaa801b13413ce2a9bb64e8dd9 WatchSource:0}: Error finding container 5bc5d6c8dbd8c5ba1d63d4fc4a82de47aba57deaa801b13413ce2a9bb64e8dd9: Status 404 returned error can't find the container with id 5bc5d6c8dbd8c5ba1d63d4fc4a82de47aba57deaa801b13413ce2a9bb64e8dd9 Jul 06 20:49:59.376795 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.376761 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-fxmcj"] Jul 06 20:49:59.379710 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:49:59.379683 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec4b5d3_3779_4781_809d_da31fe3a5c6c.slice/crio-01889ef0ca1be4ef3e0bc8060638084b9e248aadfcc81b2825cf3600fcee53c8 WatchSource:0}: Error finding container 01889ef0ca1be4ef3e0bc8060638084b9e248aadfcc81b2825cf3600fcee53c8: Status 404 returned error can't find the container with id 01889ef0ca1be4ef3e0bc8060638084b9e248aadfcc81b2825cf3600fcee53c8 Jul 06 20:49:59.520213 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.520176 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" event={"ID":"5ec4b5d3-3779-4781-809d-da31fe3a5c6c","Type":"ContainerStarted","Data":"01889ef0ca1be4ef3e0bc8060638084b9e248aadfcc81b2825cf3600fcee53c8"} Jul 06 20:49:59.521143 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.521116 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94" event={"ID":"14e83e77-682c-4ed5-b8d9-d4bc425c5b26","Type":"ContainerStarted","Data":"5bc5d6c8dbd8c5ba1d63d4fc4a82de47aba57deaa801b13413ce2a9bb64e8dd9"} Jul 06 20:49:59.551634 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:49:59.551596 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-sblqf\" (UID: \"194a28e3-35af-4241-9e8e-49de37b200dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf" Jul 06 20:49:59.551770 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:59.551750 2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 20:49:59.551826 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:49:59.551818 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls podName:194a28e3-35af-4241-9e8e-49de37b200dc nodeName:}" failed. No retries permitted until 2026-07-06 20:50:00.551801631 +0000 UTC m=+81.885618124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-sblqf" (UID: "194a28e3-35af-4241-9e8e-49de37b200dc") : secret "samples-operator-tls" not found Jul 06 20:50:00.559932 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:00.559896 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-sblqf\" (UID: \"194a28e3-35af-4241-9e8e-49de37b200dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf" Jul 06 20:50:00.560458 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:00.560033 2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 20:50:00.560458 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:00.560120 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls podName:194a28e3-35af-4241-9e8e-49de37b200dc nodeName:}" failed. No retries permitted until 2026-07-06 20:50:02.56010111 +0000 UTC m=+83.893917609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-sblqf" (UID: "194a28e3-35af-4241-9e8e-49de37b200dc") : secret "samples-operator-tls" not found Jul 06 20:50:02.530239 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:02.530202 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94" event={"ID":"14e83e77-682c-4ed5-b8d9-d4bc425c5b26","Type":"ContainerStarted","Data":"ccb793ea6c0c675315dd106d84bc72a846d188de6dcd6c07c7795830051ab697"} Jul 06 20:50:02.531872 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:02.531849 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fxmcj_5ec4b5d3-3779-4781-809d-da31fe3a5c6c/console-operator/0.log" Jul 06 20:50:02.531988 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:02.531887 2586 generic.go:356] "Generic (PLEG): container finished" podID="5ec4b5d3-3779-4781-809d-da31fe3a5c6c" containerID="a0c209f7d3d32f7985265c5bc20dacd8867700f7a5fcc84a5b2667716bb3f0d5" exitCode=255 Jul 06 20:50:02.531988 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:02.531916 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" event={"ID":"5ec4b5d3-3779-4781-809d-da31fe3a5c6c","Type":"ContainerDied","Data":"a0c209f7d3d32f7985265c5bc20dacd8867700f7a5fcc84a5b2667716bb3f0d5"} Jul 06 20:50:02.532223 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:02.532206 2586 scope.go:117] "RemoveContainer" containerID="a0c209f7d3d32f7985265c5bc20dacd8867700f7a5fcc84a5b2667716bb3f0d5" Jul 06 20:50:02.552338 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:02.552283 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94" podStartSLOduration=2.104106456 podStartE2EDuration="4.552241588s" totalImagesPullingTime="2.448135132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:49:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:02.551336681 +0000 UTC m=+83.885153194" watchObservedRunningTime="2026-07-06 20:50:02.552241588 +0000 UTC m=+83.886058102" Jul 06 20:50:02.577232 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:02.577193 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-sblqf\" (UID: \"194a28e3-35af-4241-9e8e-49de37b200dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf" Jul 06 20:50:02.577495 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:02.577410 2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 20:50:02.577495 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:02.577495 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls podName:194a28e3-35af-4241-9e8e-49de37b200dc nodeName:}" failed. No retries permitted until 2026-07-06 20:50:06.5774718 +0000 UTC m=+87.911288303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-sblqf" (UID: "194a28e3-35af-4241-9e8e-49de37b200dc") : secret "samples-operator-tls" not found Jul 06 20:50:03.424250 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.424214 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jxl99"] Jul 06 20:50:03.427622 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.427602 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:03.430639 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.430611 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 20:50:03.430789 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.430623 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 20:50:03.430915 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.430901 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 20:50:03.431741 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.431722 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ggcqj\"" Jul 06 20:50:03.431852 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.431758 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 20:50:03.446735 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.446696 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jxl99"] Jul 06 20:50:03.536602 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.536572 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fxmcj_5ec4b5d3-3779-4781-809d-da31fe3a5c6c/console-operator/1.log" Jul 06 20:50:03.537046 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.537029 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fxmcj_5ec4b5d3-3779-4781-809d-da31fe3a5c6c/console-operator/0.log" Jul 06 20:50:03.537157 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.537072 2586 generic.go:356] "Generic (PLEG): container finished" podID="5ec4b5d3-3779-4781-809d-da31fe3a5c6c" containerID="6f78d892119e3c3e9324da11c22eacb8910624ddbc4269d5da7828e7a3dd942c" exitCode=255 Jul 06 20:50:03.537209 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.537169 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" event={"ID":"5ec4b5d3-3779-4781-809d-da31fe3a5c6c","Type":"ContainerDied","Data":"6f78d892119e3c3e9324da11c22eacb8910624ddbc4269d5da7828e7a3dd942c"} Jul 06 20:50:03.537258 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.537223 2586 scope.go:117] "RemoveContainer" containerID="a0c209f7d3d32f7985265c5bc20dacd8867700f7a5fcc84a5b2667716bb3f0d5" Jul 06 20:50:03.537451 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.537437 2586 scope.go:117] "RemoveContainer" containerID="6f78d892119e3c3e9324da11c22eacb8910624ddbc4269d5da7828e7a3dd942c" Jul 06 20:50:03.537637 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:03.537616 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-fxmcj_openshift-console-operator(5ec4b5d3-3779-4781-809d-da31fe3a5c6c)\"" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" podUID="5ec4b5d3-3779-4781-809d-da31fe3a5c6c" Jul 06 20:50:03.586839 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.586804 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:03.587013 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.586865 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5d5ca02-9487-4300-9272-dce7514c8492-crio-socket\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:03.587013 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.586921 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5d5ca02-9487-4300-9272-dce7514c8492-data-volume\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:03.587118 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.587035 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rgcl\" (UniqueName: \"kubernetes.io/projected/a5d5ca02-9487-4300-9272-dce7514c8492-kube-api-access-7rgcl\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:03.587118 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.587054 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:03.687691 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.687608 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:03.687691 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.687648 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:03.687980 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.687753 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5d5ca02-9487-4300-9272-dce7514c8492-crio-socket\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:03.687980 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.687792 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5d5ca02-9487-4300-9272-dce7514c8492-data-volume\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:03.687980 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.687864 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5d5ca02-9487-4300-9272-dce7514c8492-crio-socket\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:03.687980 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:03.687794 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:50:03.687980 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:03.687901 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:50:03.687980 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:03.687976 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm podName:a5d5ca02-9487-4300-9272-dce7514c8492 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:04.187953954 +0000 UTC m=+85.521770465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jxl99" (UID: "a5d5ca02-9487-4300-9272-dce7514c8492") : configmap "kube-rbac-proxy" not found Jul 06 20:50:03.688280 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:03.688068 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls podName:a5d5ca02-9487-4300-9272-dce7514c8492 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:04.188049617 +0000 UTC m=+85.521866118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jxl99" (UID: "a5d5ca02-9487-4300-9272-dce7514c8492") : secret "insights-runtime-extractor-tls" not found Jul 06 20:50:03.688280 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.688111 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5d5ca02-9487-4300-9272-dce7514c8492-data-volume\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:03.688280 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.688168 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rgcl\" (UniqueName: \"kubernetes.io/projected/a5d5ca02-9487-4300-9272-dce7514c8492-kube-api-access-7rgcl\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:03.702028 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:03.701995 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rgcl\" (UniqueName: \"kubernetes.io/projected/a5d5ca02-9487-4300-9272-dce7514c8492-kube-api-access-7rgcl\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:04.191937 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:04.191877 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:04.192158 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:04.191975 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:04.192158 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:04.192030 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:50:04.192158 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:04.192135 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm podName:a5d5ca02-9487-4300-9272-dce7514c8492 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:05.192114567 +0000 UTC m=+86.525931072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jxl99" (UID: "a5d5ca02-9487-4300-9272-dce7514c8492") : configmap "kube-rbac-proxy" not found Jul 06 20:50:04.192340 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:04.192222 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:50:04.192340 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:04.192274 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls podName:a5d5ca02-9487-4300-9272-dce7514c8492 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:05.192253386 +0000 UTC m=+86.526069896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jxl99" (UID: "a5d5ca02-9487-4300-9272-dce7514c8492") : secret "insights-runtime-extractor-tls" not found Jul 06 20:50:04.541322 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:04.541238 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fxmcj_5ec4b5d3-3779-4781-809d-da31fe3a5c6c/console-operator/1.log" Jul 06 20:50:04.541667 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:04.541576 2586 scope.go:117] "RemoveContainer" containerID="6f78d892119e3c3e9324da11c22eacb8910624ddbc4269d5da7828e7a3dd942c" Jul 06 20:50:04.541744 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:04.541724 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-fxmcj_openshift-console-operator(5ec4b5d3-3779-4781-809d-da31fe3a5c6c)\"" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" podUID="5ec4b5d3-3779-4781-809d-da31fe3a5c6c" Jul 06 20:50:05.201556 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:05.201514 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:05.201556 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:05.201559 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:05.201811 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:05.201646 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:50:05.201811 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:05.201685 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:50:05.201811 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:05.201717 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm podName:a5d5ca02-9487-4300-9272-dce7514c8492 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:07.20170082 +0000 UTC m=+88.535517310 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jxl99" (UID: "a5d5ca02-9487-4300-9272-dce7514c8492") : configmap "kube-rbac-proxy" not found Jul 06 20:50:05.201811 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:05.201734 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls podName:a5d5ca02-9487-4300-9272-dce7514c8492 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:07.201728091 +0000 UTC m=+88.535544582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jxl99" (UID: "a5d5ca02-9487-4300-9272-dce7514c8492") : secret "insights-runtime-extractor-tls" not found Jul 06 20:50:05.416004 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:05.415973 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pzt4k_37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381/dns-node-resolver/0.log" Jul 06 20:50:06.210929 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:06.210893 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2d92l_67b2b0d4-1e54-408e-ae39-a626171fd87c/node-ca/0.log" Jul 06 20:50:06.613272 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:06.613184 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-sblqf\" (UID: \"194a28e3-35af-4241-9e8e-49de37b200dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf" Jul 06 20:50:06.613431 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:06.613297 2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 20:50:06.613431 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:06.613349 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls podName:194a28e3-35af-4241-9e8e-49de37b200dc nodeName:}" failed. No retries permitted until 2026-07-06 20:50:14.613335265 +0000 UTC m=+95.947151756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-sblqf" (UID: "194a28e3-35af-4241-9e8e-49de37b200dc") : secret "samples-operator-tls" not found Jul 06 20:50:07.216229 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:07.216201 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:07.216229 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:07.216234 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:07.216697 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:07.216342 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:50:07.216697 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:07.216377 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:50:07.216697 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:07.216435 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls podName:a5d5ca02-9487-4300-9272-dce7514c8492 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:11.216421084 +0000 UTC m=+92.550237574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jxl99" (UID: "a5d5ca02-9487-4300-9272-dce7514c8492") : secret "insights-runtime-extractor-tls" not found Jul 06 20:50:07.216697 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:07.216448 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm podName:a5d5ca02-9487-4300-9272-dce7514c8492 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:11.216441164 +0000 UTC m=+92.550257654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jxl99" (UID: "a5d5ca02-9487-4300-9272-dce7514c8492") : configmap "kube-rbac-proxy" not found Jul 06 20:50:07.411321 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:07.411286 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xg26k_13f352df-013d-46cf-9b1e-ef80acc6b127/serve-healthcheck-canary/0.log" Jul 06 20:50:09.248058 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:09.248022 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:50:09.248587 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:09.248094 2586 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:50:09.248587 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:09.248502 2586 scope.go:117] "RemoveContainer" containerID="6f78d892119e3c3e9324da11c22eacb8910624ddbc4269d5da7828e7a3dd942c" Jul 06 20:50:09.248752 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:09.248700 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-fxmcj_openshift-console-operator(5ec4b5d3-3779-4781-809d-da31fe3a5c6c)\"" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" podUID="5ec4b5d3-3779-4781-809d-da31fe3a5c6c" Jul 06 20:50:11.250757 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:11.250712 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:11.250757 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:11.250755 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:11.251326 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:11.250850 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:50:11.251326 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:11.250909 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:50:11.251326 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:11.250939 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm podName:a5d5ca02-9487-4300-9272-dce7514c8492 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:19.250916694 +0000 UTC m=+100.584733189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jxl99" (UID: "a5d5ca02-9487-4300-9272-dce7514c8492") : configmap "kube-rbac-proxy" not found Jul 06 20:50:11.251326 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:11.250959 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls podName:a5d5ca02-9487-4300-9272-dce7514c8492 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:19.250949499 +0000 UTC m=+100.584765989 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jxl99" (UID: "a5d5ca02-9487-4300-9272-dce7514c8492") : secret "insights-runtime-extractor-tls" not found Jul 06 20:50:14.680291 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:14.680245 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-sblqf\" (UID: \"194a28e3-35af-4241-9e8e-49de37b200dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf" Jul 06 20:50:14.682572 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:14.682549 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/194a28e3-35af-4241-9e8e-49de37b200dc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-sblqf\" (UID: \"194a28e3-35af-4241-9e8e-49de37b200dc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf" Jul 06 20:50:14.762243 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:14.762200 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf" Jul 06 20:50:14.893205 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:14.893174 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf"] Jul 06 20:50:15.574164 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:15.574113 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf" event={"ID":"194a28e3-35af-4241-9e8e-49de37b200dc","Type":"ContainerStarted","Data":"f93e679109eb20febea5ed58bee4fbc4ceb6059b3716210b9126335ae7bf5c90"} Jul 06 20:50:17.582468 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:17.582431 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf" event={"ID":"194a28e3-35af-4241-9e8e-49de37b200dc","Type":"ContainerStarted","Data":"0fe8dc2b4d3023be9be2bbb5ac4ff37c14048eb7dfb0aa74abd16050e0235e81"} Jul 06 20:50:17.582834 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:17.582489 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf" event={"ID":"194a28e3-35af-4241-9e8e-49de37b200dc","Type":"ContainerStarted","Data":"2b053c2325a95b9a563c3b80915960d982969af3ca96854af502cecf3b9a6825"} Jul 06 20:50:17.606612 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:17.606558 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-sblqf" podStartSLOduration=17.8347152 podStartE2EDuration="19.60654099s" totalImagesPullingTime="1.77182579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:49:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:17.605859903 +0000 UTC m=+98.939676417" watchObservedRunningTime="2026-07-06 20:50:17.60654099 +0000 UTC m=+98.940357502" Jul 06 20:50:18.411675 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:18.411629 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:50:18.411819 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:18.411693 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:50:18.413992 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:18.413963 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f9dfb85-aa70-4443-9923-09a46f9bdffb-metrics-tls\") pod \"dns-default-dtxbd\" (UID: \"5f9dfb85-aa70-4443-9923-09a46f9bdffb\") " pod="openshift-dns/dns-default-dtxbd" Jul 06 20:50:18.414108 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:18.414090 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls\") pod \"image-registry-59f6cb6fc6-x4p42\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:50:18.666469 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:18.666385 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f4d5n\"" Jul 06 20:50:18.668911 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:18.668881 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:50:18.679756 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:18.679735 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8q9dq\"" Jul 06 20:50:18.687008 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:18.686980 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dtxbd" Jul 06 20:50:18.810978 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:18.810931 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59f6cb6fc6-x4p42"] Jul 06 20:50:18.816500 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:50:18.816472 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ffde4f3_2adc_4563_a038_14e2232607f8.slice/crio-a9e0adccb937915ecb1fa7d5bc7ce4d3e915ef86f04d493903000b9e3e948f1d WatchSource:0}: Error finding container a9e0adccb937915ecb1fa7d5bc7ce4d3e915ef86f04d493903000b9e3e948f1d: Status 404 returned error can't find the container with id a9e0adccb937915ecb1fa7d5bc7ce4d3e915ef86f04d493903000b9e3e948f1d Jul 06 20:50:18.831462 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:18.831439 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dtxbd"] Jul 06 20:50:18.834469 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:50:18.834447 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9dfb85_aa70_4443_9923_09a46f9bdffb.slice/crio-f37eb3e2899db8953ecf818ffba96762b3ec4b08b26538096a2f01697f47fcca WatchSource:0}: Error finding container f37eb3e2899db8953ecf818ffba96762b3ec4b08b26538096a2f01697f47fcca: Status 404 returned error can't find the container with id f37eb3e2899db8953ecf818ffba96762b3ec4b08b26538096a2f01697f47fcca Jul 06 20:50:19.319957 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:19.319916 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:19.319957 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:19.319961 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:19.320212 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:19.320145 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:50:19.320255 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:19.320217 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls podName:a5d5ca02-9487-4300-9272-dce7514c8492 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:35.320198058 +0000 UTC m=+116.654014560 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jxl99" (UID: "a5d5ca02-9487-4300-9272-dce7514c8492") : secret "insights-runtime-extractor-tls" not found Jul 06 20:50:19.320598 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:19.320577 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5d5ca02-9487-4300-9272-dce7514c8492-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:19.590748 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:19.590629 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" event={"ID":"0ffde4f3-2adc-4563-a038-14e2232607f8","Type":"ContainerStarted","Data":"a2a3ca531c577c17edd0ce2e240303dc50db5a5739c6f7cf378218c01c7b75f0"} Jul 06 20:50:19.590748 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:19.590691 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" event={"ID":"0ffde4f3-2adc-4563-a038-14e2232607f8","Type":"ContainerStarted","Data":"a9e0adccb937915ecb1fa7d5bc7ce4d3e915ef86f04d493903000b9e3e948f1d"} Jul 06 20:50:19.590748 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:19.590716 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:50:19.591989 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:19.591960 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dtxbd" event={"ID":"5f9dfb85-aa70-4443-9923-09a46f9bdffb","Type":"ContainerStarted","Data":"f37eb3e2899db8953ecf818ffba96762b3ec4b08b26538096a2f01697f47fcca"} Jul 06 20:50:19.614724 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:19.614669 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" podStartSLOduration=99.614648033 podStartE2EDuration="1m39.614648033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:48:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:19.613923009 +0000 UTC m=+100.947739505" watchObservedRunningTime="2026-07-06 20:50:19.614648033 +0000 UTC m=+100.948464544" Jul 06 20:50:20.596860 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:20.596825 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dtxbd" event={"ID":"5f9dfb85-aa70-4443-9923-09a46f9bdffb","Type":"ContainerStarted","Data":"40e5d4fabeffb2841e47294bd0c75c956d8246cd2f20701b86065d5d37d1c623"} Jul 06 20:50:21.208043 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:21.208009 2586 scope.go:117] "RemoveContainer" containerID="6f78d892119e3c3e9324da11c22eacb8910624ddbc4269d5da7828e7a3dd942c" Jul 06 20:50:21.504232 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:21.504142 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rp2sj" Jul 06 20:50:21.601923 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:21.601897 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fxmcj_5ec4b5d3-3779-4781-809d-da31fe3a5c6c/console-operator/2.log" Jul 06 20:50:21.602416 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:21.602312 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fxmcj_5ec4b5d3-3779-4781-809d-da31fe3a5c6c/console-operator/1.log" Jul 06 20:50:21.602416 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:21.602341 2586 generic.go:356] "Generic (PLEG): container finished" podID="5ec4b5d3-3779-4781-809d-da31fe3a5c6c" containerID="cdf78cd8cae62e13ca4f846f1ffec3a4edca6877bdfd76750494d2b1b388e984" exitCode=255 Jul 06 20:50:21.602416 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:21.602407 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" event={"ID":"5ec4b5d3-3779-4781-809d-da31fe3a5c6c","Type":"ContainerDied","Data":"cdf78cd8cae62e13ca4f846f1ffec3a4edca6877bdfd76750494d2b1b388e984"} Jul 06 20:50:21.602565 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:21.602461 2586 scope.go:117] "RemoveContainer" containerID="6f78d892119e3c3e9324da11c22eacb8910624ddbc4269d5da7828e7a3dd942c" Jul 06 20:50:21.602873 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:21.602848 2586 scope.go:117] "RemoveContainer" containerID="cdf78cd8cae62e13ca4f846f1ffec3a4edca6877bdfd76750494d2b1b388e984" Jul 06 20:50:21.603112 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:21.603063 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-fxmcj_openshift-console-operator(5ec4b5d3-3779-4781-809d-da31fe3a5c6c)\"" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" podUID="5ec4b5d3-3779-4781-809d-da31fe3a5c6c" Jul 06 20:50:21.604323 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:21.604302 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dtxbd" event={"ID":"5f9dfb85-aa70-4443-9923-09a46f9bdffb","Type":"ContainerStarted","Data":"530e750b5349a83642c9d097e7a092c1b130cff23a6b2437c338928f7852ae37"} Jul 06 20:50:21.604438 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:21.604421 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dtxbd" Jul 06 20:50:21.644699 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:21.644646 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dtxbd" podStartSLOduration=66.077237148 podStartE2EDuration="1m7.644628599s" totalImagesPullingTime="1.567391451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:21.643274431 +0000 UTC m=+102.977090945" watchObservedRunningTime="2026-07-06 20:50:21.644628599 +0000 UTC m=+102.978445430" Jul 06 20:50:22.609129 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:22.609097 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fxmcj_5ec4b5d3-3779-4781-809d-da31fe3a5c6c/console-operator/2.log" Jul 06 20:50:27.149141 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.149107 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-wjl9z"] Jul 06 20:50:27.151593 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.151575 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wjl9z" Jul 06 20:50:27.153355 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.153327 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb"] Jul 06 20:50:27.154981 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.154966 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb" Jul 06 20:50:27.162606 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.162584 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 20:50:27.163510 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.163483 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 20:50:27.163510 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.163496 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 20:50:27.163692 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.163520 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-st5kt\"" Jul 06 20:50:27.163692 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.163494 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 20:50:27.163692 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.163641 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 06 20:50:27.163850 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.163743 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 20:50:27.168855 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.168836 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-wjl9z"] Jul 06 20:50:27.183031 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.183003 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb"] Jul 06 20:50:27.281662 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.281629 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42d8a7a5-43b6-4bf6-8c62-9491dffcd31a-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-wjl9z\" (UID: \"42d8a7a5-43b6-4bf6-8c62-9491dffcd31a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wjl9z" Jul 06 20:50:27.281844 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.281718 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/eb7711d0-f128-46ec-ab23-cbedb1de16b3-klusterlet-config\") pod \"klusterlet-addon-workmgr-6547bb67f9-zlpxb\" (UID: \"eb7711d0-f128-46ec-ab23-cbedb1de16b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb" Jul 06 20:50:27.281844 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.281744 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb7711d0-f128-46ec-ab23-cbedb1de16b3-tmp\") pod \"klusterlet-addon-workmgr-6547bb67f9-zlpxb\" (UID: \"eb7711d0-f128-46ec-ab23-cbedb1de16b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb" Jul 06 20:50:27.281844 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.281766 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j5kf\" (UniqueName: \"kubernetes.io/projected/eb7711d0-f128-46ec-ab23-cbedb1de16b3-kube-api-access-2j5kf\") pod \"klusterlet-addon-workmgr-6547bb67f9-zlpxb\" (UID: \"eb7711d0-f128-46ec-ab23-cbedb1de16b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb" Jul 06 20:50:27.281844 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.281796 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42d8a7a5-43b6-4bf6-8c62-9491dffcd31a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wjl9z\" (UID: \"42d8a7a5-43b6-4bf6-8c62-9491dffcd31a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wjl9z" Jul 06 20:50:27.382721 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.382689 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/eb7711d0-f128-46ec-ab23-cbedb1de16b3-klusterlet-config\") pod \"klusterlet-addon-workmgr-6547bb67f9-zlpxb\" (UID: \"eb7711d0-f128-46ec-ab23-cbedb1de16b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb" Jul 06 20:50:27.382721 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.382730 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb7711d0-f128-46ec-ab23-cbedb1de16b3-tmp\") pod \"klusterlet-addon-workmgr-6547bb67f9-zlpxb\" (UID: \"eb7711d0-f128-46ec-ab23-cbedb1de16b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb" Jul 06 20:50:27.382960 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.382766 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j5kf\" (UniqueName: \"kubernetes.io/projected/eb7711d0-f128-46ec-ab23-cbedb1de16b3-kube-api-access-2j5kf\") pod \"klusterlet-addon-workmgr-6547bb67f9-zlpxb\" (UID: \"eb7711d0-f128-46ec-ab23-cbedb1de16b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb" Jul 06 20:50:27.382960 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.382804 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42d8a7a5-43b6-4bf6-8c62-9491dffcd31a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wjl9z\" (UID: \"42d8a7a5-43b6-4bf6-8c62-9491dffcd31a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wjl9z" Jul 06 20:50:27.382960 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.382857 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42d8a7a5-43b6-4bf6-8c62-9491dffcd31a-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-wjl9z\" (UID: \"42d8a7a5-43b6-4bf6-8c62-9491dffcd31a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wjl9z" Jul 06 20:50:27.383227 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.383200 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb7711d0-f128-46ec-ab23-cbedb1de16b3-tmp\") pod \"klusterlet-addon-workmgr-6547bb67f9-zlpxb\" (UID: \"eb7711d0-f128-46ec-ab23-cbedb1de16b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb" Jul 06 20:50:27.383691 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.383667 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42d8a7a5-43b6-4bf6-8c62-9491dffcd31a-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-wjl9z\" (UID: \"42d8a7a5-43b6-4bf6-8c62-9491dffcd31a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wjl9z" Jul 06 20:50:27.385416 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.385374 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/eb7711d0-f128-46ec-ab23-cbedb1de16b3-klusterlet-config\") pod \"klusterlet-addon-workmgr-6547bb67f9-zlpxb\" (UID: \"eb7711d0-f128-46ec-ab23-cbedb1de16b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb" Jul 06 20:50:27.385533 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.385491 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42d8a7a5-43b6-4bf6-8c62-9491dffcd31a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wjl9z\" (UID: \"42d8a7a5-43b6-4bf6-8c62-9491dffcd31a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wjl9z" Jul 06 20:50:27.397720 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.397696 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j5kf\" (UniqueName: \"kubernetes.io/projected/eb7711d0-f128-46ec-ab23-cbedb1de16b3-kube-api-access-2j5kf\") pod \"klusterlet-addon-workmgr-6547bb67f9-zlpxb\" (UID: \"eb7711d0-f128-46ec-ab23-cbedb1de16b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb" Jul 06 20:50:27.462004 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.461967 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wjl9z" Jul 06 20:50:27.467378 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.467357 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb" Jul 06 20:50:27.603998 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.603961 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-wjl9z"] Jul 06 20:50:27.606696 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:50:27.606669 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d8a7a5_43b6_4bf6_8c62_9491dffcd31a.slice/crio-e2b909a17625b8bb0420cbda850628d79f9f43c991ad2f4a3b8ef6bc74bc0e8c WatchSource:0}: Error finding container e2b909a17625b8bb0420cbda850628d79f9f43c991ad2f4a3b8ef6bc74bc0e8c: Status 404 returned error can't find the container with id e2b909a17625b8bb0420cbda850628d79f9f43c991ad2f4a3b8ef6bc74bc0e8c Jul 06 20:50:27.623135 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.623110 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb"] Jul 06 20:50:27.626337 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:50:27.626311 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb7711d0_f128_46ec_ab23_cbedb1de16b3.slice/crio-be0fa12ccd74c41294ad25dec1dfc4fe5efa5681ff6369f81c46411e0b47b826 WatchSource:0}: Error finding container be0fa12ccd74c41294ad25dec1dfc4fe5efa5681ff6369f81c46411e0b47b826: Status 404 returned error can't find the container with id be0fa12ccd74c41294ad25dec1dfc4fe5efa5681ff6369f81c46411e0b47b826 Jul 06 20:50:27.627283 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:27.627257 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wjl9z" event={"ID":"42d8a7a5-43b6-4bf6-8c62-9491dffcd31a","Type":"ContainerStarted","Data":"e2b909a17625b8bb0420cbda850628d79f9f43c991ad2f4a3b8ef6bc74bc0e8c"} Jul 06 20:50:28.634484 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:28.634441 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb" event={"ID":"eb7711d0-f128-46ec-ab23-cbedb1de16b3","Type":"ContainerStarted","Data":"be0fa12ccd74c41294ad25dec1dfc4fe5efa5681ff6369f81c46411e0b47b826"} Jul 06 20:50:29.248376 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:29.248176 2586 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:50:29.248549 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:29.248402 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:50:29.248811 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:29.248794 2586 scope.go:117] "RemoveContainer" containerID="cdf78cd8cae62e13ca4f846f1ffec3a4edca6877bdfd76750494d2b1b388e984" Jul 06 20:50:29.249011 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:29.248987 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-fxmcj_openshift-console-operator(5ec4b5d3-3779-4781-809d-da31fe3a5c6c)\"" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" podUID="5ec4b5d3-3779-4781-809d-da31fe3a5c6c" Jul 06 20:50:29.641167 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:29.640935 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wjl9z" event={"ID":"42d8a7a5-43b6-4bf6-8c62-9491dffcd31a","Type":"ContainerStarted","Data":"b0c42d62596216d461d0d8c1b14f604da1e304e8033b52689db48d66896d05da"} Jul 06 20:50:29.669496 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:29.669434 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wjl9z" podStartSLOduration=1.53871519 podStartE2EDuration="2.669416461s" totalImagesPullingTime="1.130701271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:29.668238065 +0000 UTC m=+111.002054578" watchObservedRunningTime="2026-07-06 20:50:29.669416461 +0000 UTC m=+111.003232973" Jul 06 20:50:31.611734 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:31.611656 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dtxbd" Jul 06 20:50:31.650297 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:31.650249 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb" event={"ID":"eb7711d0-f128-46ec-ab23-cbedb1de16b3","Type":"ContainerStarted","Data":"bb3ac4dfd366eb238e067915e856210108be54f4d01077517db3e06f6ab9e20d"} Jul 06 20:50:31.650471 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:31.650445 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb" Jul 06 20:50:31.652331 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:31.652308 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb" Jul 06 20:50:31.669420 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:31.669367 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6547bb67f9-zlpxb" podStartSLOduration=1.138313367 podStartE2EDuration="4.669350665s" totalImagesPullingTime="3.531037298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:31.667938951 +0000 UTC m=+113.001755485" watchObservedRunningTime="2026-07-06 20:50:31.669350665 +0000 UTC m=+113.003167176" Jul 06 20:50:33.454327 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:33.454290 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x766l"] Jul 06 20:50:33.457471 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:33.457451 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x766l" Jul 06 20:50:33.461173 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:33.461142 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 20:50:33.461299 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:33.461153 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cpbtp\"" Jul 06 20:50:33.480260 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:33.480232 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x766l"] Jul 06 20:50:33.532924 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:33.532877 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/82a473cb-618d-4588-8618-f9c6521f2024-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-x766l\" (UID: \"82a473cb-618d-4588-8618-f9c6521f2024\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x766l" Jul 06 20:50:33.634059 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:33.634021 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/82a473cb-618d-4588-8618-f9c6521f2024-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-x766l\" (UID: \"82a473cb-618d-4588-8618-f9c6521f2024\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x766l" Jul 06 20:50:33.636402 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:33.636378 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/82a473cb-618d-4588-8618-f9c6521f2024-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-x766l\" (UID: \"82a473cb-618d-4588-8618-f9c6521f2024\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x766l" Jul 06 20:50:33.766187 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:33.766100 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x766l" Jul 06 20:50:33.910717 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:33.910681 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x766l"] Jul 06 20:50:33.913640 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:50:33.913613 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a473cb_618d_4588_8618_f9c6521f2024.slice/crio-d648caea4316e26bbed73d49ebb40b85f93a863f9e96bce1e4b02c3a24149941 WatchSource:0}: Error finding container d648caea4316e26bbed73d49ebb40b85f93a863f9e96bce1e4b02c3a24149941: Status 404 returned error can't find the container with id d648caea4316e26bbed73d49ebb40b85f93a863f9e96bce1e4b02c3a24149941 Jul 06 20:50:34.661368 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:34.661334 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x766l" event={"ID":"82a473cb-618d-4588-8618-f9c6521f2024","Type":"ContainerStarted","Data":"d648caea4316e26bbed73d49ebb40b85f93a863f9e96bce1e4b02c3a24149941"} Jul 06 20:50:35.348254 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:35.348208 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:35.350626 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:35.350601 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5d5ca02-9487-4300-9272-dce7514c8492-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jxl99\" (UID: \"a5d5ca02-9487-4300-9272-dce7514c8492\") " pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:35.536661 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:35.536623 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jxl99" Jul 06 20:50:35.665759 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:35.665723 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x766l" event={"ID":"82a473cb-618d-4588-8618-f9c6521f2024","Type":"ContainerStarted","Data":"57ffc1ad52089e553f42ccf0437ddd7b56f2a2862258e405594be1656c33a7a5"} Jul 06 20:50:35.666198 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:35.665909 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x766l" Jul 06 20:50:35.668116 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:35.668092 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jxl99"] Jul 06 20:50:35.670842 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:35.670809 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x766l" Jul 06 20:50:35.671853 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:50:35.671829 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d5ca02_9487_4300_9272_dce7514c8492.slice/crio-87908df5c0f06193f72730374e8203ed62a0ec3c7632f18445be44e61f7488db WatchSource:0}: Error finding container 87908df5c0f06193f72730374e8203ed62a0ec3c7632f18445be44e61f7488db: Status 404 returned error can't find the container with id 87908df5c0f06193f72730374e8203ed62a0ec3c7632f18445be44e61f7488db Jul 06 20:50:35.691777 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:35.691723 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-x766l" podStartSLOduration=1.792288982 podStartE2EDuration="2.691707798s" totalImagesPullingTime="899.418816ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:35.691362133 +0000 UTC m=+117.025178645" watchObservedRunningTime="2026-07-06 20:50:35.691707798 +0000 UTC m=+117.025524310" Jul 06 20:50:36.670860 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:36.670814 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jxl99" event={"ID":"a5d5ca02-9487-4300-9272-dce7514c8492","Type":"ContainerStarted","Data":"87908df5c0f06193f72730374e8203ed62a0ec3c7632f18445be44e61f7488db"} Jul 06 20:50:38.674810 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:38.674768 2586 patch_prober.go:28] interesting pod/image-registry-59f6cb6fc6-x4p42 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 20:50:38.675355 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:38.674832 2586 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" podUID="0ffde4f3-2adc-4563-a038-14e2232607f8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 20:50:39.683066 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:39.683032 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jxl99" event={"ID":"a5d5ca02-9487-4300-9272-dce7514c8492","Type":"ContainerStarted","Data":"876c9a3edfbaf22a52cbc52814dbbe476af281c83f1a9f310a917c03669d1c60"} Jul 06 20:50:40.208392 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:40.208360 2586 scope.go:117] "RemoveContainer" containerID="cdf78cd8cae62e13ca4f846f1ffec3a4edca6877bdfd76750494d2b1b388e984" Jul 06 20:50:40.208559 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:40.208522 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-fxmcj_openshift-console-operator(5ec4b5d3-3779-4781-809d-da31fe3a5c6c)\"" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" podUID="5ec4b5d3-3779-4781-809d-da31fe3a5c6c" Jul 06 20:50:40.601645 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:40.601614 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:50:40.688479 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:40.688440 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jxl99" event={"ID":"a5d5ca02-9487-4300-9272-dce7514c8492","Type":"ContainerStarted","Data":"6013a7b65f1087e8a305df9172380d32de31517efb05a2990d6e29cc31bf5e4f"} Jul 06 20:50:42.696914 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.696872 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jxl99" event={"ID":"a5d5ca02-9487-4300-9272-dce7514c8492","Type":"ContainerStarted","Data":"9dfb44d3087eae604de08dd50bf8645288e69553daab45f0a0da380d359abcb8"} Jul 06 20:50:42.720750 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.720679 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jxl99" podStartSLOduration=33.033392989 podStartE2EDuration="39.720661915s" totalImagesPullingTime="6.687268926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:50:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:42.719424713 +0000 UTC m=+124.053241224" watchObservedRunningTime="2026-07-06 20:50:42.720661915 +0000 UTC m=+124.054478435" Jul 06 20:50:42.901996 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.901913 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km"] Jul 06 20:50:42.905319 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.905303 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" Jul 06 20:50:42.908255 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.908232 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 20:50:42.908255 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.908245 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 20:50:42.908255 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.908265 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fknkh\"" Jul 06 20:50:42.908511 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.908236 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 20:50:42.908511 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.908326 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 20:50:42.908725 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.908706 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 20:50:42.925092 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.925054 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km"] Jul 06 20:50:42.944671 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.944639 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb"] Jul 06 20:50:42.947801 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.947778 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:42.950742 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.950718 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 20:50:42.950869 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.950785 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vvx25\"" Jul 06 20:50:42.950869 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.950721 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 20:50:42.950869 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.950726 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 20:50:42.963778 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.963750 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb"] Jul 06 20:50:42.966576 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.966545 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k88pb"] Jul 06 20:50:42.969698 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.969677 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:42.972371 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.972350 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 20:50:42.972371 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.972366 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 20:50:42.972534 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.972490 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f7jz5\"" Jul 06 20:50:42.972605 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:42.972530 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 20:50:43.014959 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.014926 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb3675c5-0128-4724-a601-e70d773a29d3-metrics-client-ca\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.014959 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.014962 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/996eb26e-3964-4408-b19b-dc22f09e9cfa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-jr8km\" (UID: \"996eb26e-3964-4408-b19b-dc22f09e9cfa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" Jul 06 20:50:43.015214 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.014981 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-tls\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.015214 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.015026 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-wtmp\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.015214 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.015055 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.015214 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.015117 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb3675c5-0128-4724-a601-e70d773a29d3-sys\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.015214 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.015141 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4d8713b-e22f-4b14-9f60-0d3828631a89-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.015214 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.015178 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4d8713b-e22f-4b14-9f60-0d3828631a89-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.015214 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.015198 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a4d8713b-e22f-4b14-9f60-0d3828631a89-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.015214 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.015216 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/996eb26e-3964-4408-b19b-dc22f09e9cfa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-jr8km\" (UID: \"996eb26e-3964-4408-b19b-dc22f09e9cfa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" Jul 06 20:50:43.015534 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.015254 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/996eb26e-3964-4408-b19b-dc22f09e9cfa-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-jr8km\" (UID: \"996eb26e-3964-4408-b19b-dc22f09e9cfa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" Jul 06 20:50:43.015534 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.015295 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a4d8713b-e22f-4b14-9f60-0d3828631a89-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.015534 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.015339 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4d8713b-e22f-4b14-9f60-0d3828631a89-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.015534 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.015369 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb3675c5-0128-4724-a601-e70d773a29d3-root\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.015534 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.015391 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxdp6\" (UniqueName: \"kubernetes.io/projected/a4d8713b-e22f-4b14-9f60-0d3828631a89-kube-api-access-wxdp6\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.015534 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.015412 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7l9s\" (UniqueName: \"kubernetes.io/projected/996eb26e-3964-4408-b19b-dc22f09e9cfa-kube-api-access-k7l9s\") pod \"openshift-state-metrics-54cf96dfcf-jr8km\" (UID: \"996eb26e-3964-4408-b19b-dc22f09e9cfa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" Jul 06 20:50:43.015534 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.015440 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb9gv\" (UniqueName: \"kubernetes.io/projected/eb3675c5-0128-4724-a601-e70d773a29d3-kube-api-access-pb9gv\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.015534 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.015495 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.015534 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.015513 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-textfile\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.116020 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.115981 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4d8713b-e22f-4b14-9f60-0d3828631a89-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.116020 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116020 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4d8713b-e22f-4b14-9f60-0d3828631a89-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.116341 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116042 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a4d8713b-e22f-4b14-9f60-0d3828631a89-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.116341 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116108 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/996eb26e-3964-4408-b19b-dc22f09e9cfa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-jr8km\" (UID: \"996eb26e-3964-4408-b19b-dc22f09e9cfa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" Jul 06 20:50:43.116341 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116140 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/996eb26e-3964-4408-b19b-dc22f09e9cfa-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-jr8km\" (UID: \"996eb26e-3964-4408-b19b-dc22f09e9cfa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" Jul 06 20:50:43.116341 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116166 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a4d8713b-e22f-4b14-9f60-0d3828631a89-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.116341 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116210 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4d8713b-e22f-4b14-9f60-0d3828631a89-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.116341 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116244 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb3675c5-0128-4724-a601-e70d773a29d3-root\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.116341 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116288 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxdp6\" (UniqueName: \"kubernetes.io/projected/a4d8713b-e22f-4b14-9f60-0d3828631a89-kube-api-access-wxdp6\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.116341 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116313 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7l9s\" (UniqueName: \"kubernetes.io/projected/996eb26e-3964-4408-b19b-dc22f09e9cfa-kube-api-access-k7l9s\") pod \"openshift-state-metrics-54cf96dfcf-jr8km\" (UID: \"996eb26e-3964-4408-b19b-dc22f09e9cfa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" Jul 06 20:50:43.116341 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116338 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb9gv\" (UniqueName: \"kubernetes.io/projected/eb3675c5-0128-4724-a601-e70d773a29d3-kube-api-access-pb9gv\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.116780 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116396 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.116780 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116429 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-textfile\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.116780 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116488 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb3675c5-0128-4724-a601-e70d773a29d3-metrics-client-ca\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.116780 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116526 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/996eb26e-3964-4408-b19b-dc22f09e9cfa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-jr8km\" (UID: \"996eb26e-3964-4408-b19b-dc22f09e9cfa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" Jul 06 20:50:43.116780 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116553 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-tls\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.116780 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116576 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-wtmp\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.116780 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116602 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.116780 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116620 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a4d8713b-e22f-4b14-9f60-0d3828631a89-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.116780 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116670 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb3675c5-0128-4724-a601-e70d773a29d3-sys\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.116780 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116760 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb3675c5-0128-4724-a601-e70d773a29d3-sys\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.117292 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116877 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a4d8713b-e22f-4b14-9f60-0d3828631a89-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.117292 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116899 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4d8713b-e22f-4b14-9f60-0d3828631a89-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.117292 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.116933 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/996eb26e-3964-4408-b19b-dc22f09e9cfa-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-jr8km\" (UID: \"996eb26e-3964-4408-b19b-dc22f09e9cfa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" Jul 06 20:50:43.117292 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:43.117034 2586 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 20:50:43.117292 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:43.117125 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-tls podName:eb3675c5-0128-4724-a601-e70d773a29d3 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:43.617104349 +0000 UTC m=+124.950920845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-tls") pod "node-exporter-k88pb" (UID: "eb3675c5-0128-4724-a601-e70d773a29d3") : secret "node-exporter-tls" not found Jul 06 20:50:43.117292 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.117178 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.117292 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.117280 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb3675c5-0128-4724-a601-e70d773a29d3-root\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.117836 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.117309 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-wtmp\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.117836 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.117531 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-textfile\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.117957 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.117840 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb3675c5-0128-4724-a601-e70d773a29d3-metrics-client-ca\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.119089 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.119041 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4d8713b-e22f-4b14-9f60-0d3828631a89-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.119235 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.119215 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/996eb26e-3964-4408-b19b-dc22f09e9cfa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-jr8km\" (UID: \"996eb26e-3964-4408-b19b-dc22f09e9cfa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" Jul 06 20:50:43.119359 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.119339 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/996eb26e-3964-4408-b19b-dc22f09e9cfa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-jr8km\" (UID: \"996eb26e-3964-4408-b19b-dc22f09e9cfa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" Jul 06 20:50:43.119592 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.119571 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.120050 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.120031 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4d8713b-e22f-4b14-9f60-0d3828631a89-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.128444 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.128418 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb9gv\" (UniqueName: \"kubernetes.io/projected/eb3675c5-0128-4724-a601-e70d773a29d3-kube-api-access-pb9gv\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.129195 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.129171 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxdp6\" (UniqueName: \"kubernetes.io/projected/a4d8713b-e22f-4b14-9f60-0d3828631a89-kube-api-access-wxdp6\") pod \"kube-state-metrics-7c9dbb8b7d-8sdtb\" (UID: \"a4d8713b-e22f-4b14-9f60-0d3828631a89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.129304 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.129275 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7l9s\" (UniqueName: \"kubernetes.io/projected/996eb26e-3964-4408-b19b-dc22f09e9cfa-kube-api-access-k7l9s\") pod \"openshift-state-metrics-54cf96dfcf-jr8km\" (UID: \"996eb26e-3964-4408-b19b-dc22f09e9cfa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" Jul 06 20:50:43.214007 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.213974 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" Jul 06 20:50:43.257229 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.257197 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" Jul 06 20:50:43.360918 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.360882 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km"] Jul 06 20:50:43.364869 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:50:43.364844 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod996eb26e_3964_4408_b19b_dc22f09e9cfa.slice/crio-195bd79d13877af776016bb0e3415ddee4c8205bd02977a755d1d3822ea1ba74 WatchSource:0}: Error finding container 195bd79d13877af776016bb0e3415ddee4c8205bd02977a755d1d3822ea1ba74: Status 404 returned error can't find the container with id 195bd79d13877af776016bb0e3415ddee4c8205bd02977a755d1d3822ea1ba74 Jul 06 20:50:43.412578 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.412509 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb"] Jul 06 20:50:43.416429 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:50:43.416409 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d8713b_e22f_4b14_9f60_0d3828631a89.slice/crio-d10f79348b8b1dddc1a0ff9c7866f3ad37bb46ad4a1861631dac33b707e7855f WatchSource:0}: Error finding container d10f79348b8b1dddc1a0ff9c7866f3ad37bb46ad4a1861631dac33b707e7855f: Status 404 returned error can't find the container with id d10f79348b8b1dddc1a0ff9c7866f3ad37bb46ad4a1861631dac33b707e7855f Jul 06 20:50:43.619814 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.619781 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-tls\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.622020 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.622002 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb3675c5-0128-4724-a601-e70d773a29d3-node-exporter-tls\") pod \"node-exporter-k88pb\" (UID: \"eb3675c5-0128-4724-a601-e70d773a29d3\") " pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.702269 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.702217 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" event={"ID":"996eb26e-3964-4408-b19b-dc22f09e9cfa","Type":"ContainerStarted","Data":"b599dcf5fbc506742881c5d590f01eb0e30a130ef538031ddb18242d92d90be2"} Jul 06 20:50:43.702677 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.702300 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" event={"ID":"996eb26e-3964-4408-b19b-dc22f09e9cfa","Type":"ContainerStarted","Data":"fcfd9b6cc3c8ca35cefc2f6bac81bb1511ff627ae6b2e9d0ece259bc59a41994"} Jul 06 20:50:43.702677 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.702330 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" event={"ID":"996eb26e-3964-4408-b19b-dc22f09e9cfa","Type":"ContainerStarted","Data":"195bd79d13877af776016bb0e3415ddee4c8205bd02977a755d1d3822ea1ba74"} Jul 06 20:50:43.703374 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.703350 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" event={"ID":"a4d8713b-e22f-4b14-9f60-0d3828631a89","Type":"ContainerStarted","Data":"d10f79348b8b1dddc1a0ff9c7866f3ad37bb46ad4a1861631dac33b707e7855f"} Jul 06 20:50:43.878153 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:43.878045 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k88pb" Jul 06 20:50:43.889476 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:50:43.889449 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb3675c5_0128_4724_a601_e70d773a29d3.slice/crio-e22d1055a3b85d5f6ed8fc8fe128fe57b8baf52cf03397fe32b45e596c5b4e39 WatchSource:0}: Error finding container e22d1055a3b85d5f6ed8fc8fe128fe57b8baf52cf03397fe32b45e596c5b4e39: Status 404 returned error can't find the container with id e22d1055a3b85d5f6ed8fc8fe128fe57b8baf52cf03397fe32b45e596c5b4e39 Jul 06 20:50:44.219357 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.219312 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:50:44.223387 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.223359 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.230506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.230479 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 20:50:44.231633 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.230643 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 20:50:44.231633 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.230666 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 20:50:44.231633 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.231403 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 20:50:44.231633 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.230715 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 20:50:44.231633 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.230772 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 20:50:44.231633 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.230792 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 20:50:44.231633 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.231540 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 20:50:44.231633 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.231611 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6ctns\"" Jul 06 20:50:44.245163 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.245132 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 20:50:44.259895 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.259862 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:50:44.325355 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.325324 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxg24\" (UniqueName: \"kubernetes.io/projected/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-kube-api-access-jxg24\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.325355 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.325361 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.325550 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.325387 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.325550 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.325406 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.325550 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.325462 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.325550 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.325517 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-config-volume\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.325550 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.325538 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.325781 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.325564 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.325781 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.325585 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-config-out\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.325781 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.325605 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.325781 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.325650 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-web-config\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.325781 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.325729 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.325781 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.325755 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.426875 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.426835 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-config-out\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.427120 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.426891 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.427120 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.426923 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-web-config\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.427120 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.426959 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.427120 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.426990 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.427120 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.427049 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxg24\" (UniqueName: \"kubernetes.io/projected/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-kube-api-access-jxg24\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.427120 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.427102 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.427438 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.427138 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.427438 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.427163 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.427438 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.427197 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.427438 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.427224 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-config-volume\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.427438 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.427248 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.427438 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.427274 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.427438 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:44.427407 2586 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 06 20:50:44.427799 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:50:44.427468 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-main-tls podName:4422643e-bc25-48bf-a8fb-ae7a4bb17b81 nodeName:}" failed. No retries permitted until 2026-07-06 20:50:44.927449202 +0000 UTC m=+126.261265716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4422643e-bc25-48bf-a8fb-ae7a4bb17b81") : secret "alertmanager-main-tls" not found Jul 06 20:50:44.427916 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.427892 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.428245 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.428222 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.429759 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.429729 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.429965 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.429916 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-config-out\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.430191 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.430171 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.430958 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.430902 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.431052 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.431028 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-web-config\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.431138 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.431047 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.431624 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.431603 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.431909 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.431892 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.432131 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.432100 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-config-volume\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.453552 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.453516 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxg24\" (UniqueName: \"kubernetes.io/projected/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-kube-api-access-jxg24\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.709129 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.709070 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k88pb" event={"ID":"eb3675c5-0128-4724-a601-e70d773a29d3","Type":"ContainerStarted","Data":"e22d1055a3b85d5f6ed8fc8fe128fe57b8baf52cf03397fe32b45e596c5b4e39"} Jul 06 20:50:44.931443 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.931387 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:44.934533 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:44.934502 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:45.134428 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:45.134397 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:50:45.320665 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:45.320553 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:50:45.459793 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:50:45.459759 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4422643e_bc25_48bf_a8fb_ae7a4bb17b81.slice/crio-c2ce71c47eee1ccc07b85cbca95abb36205dfdace5e5aeef58adc26166ca5c7b WatchSource:0}: Error finding container c2ce71c47eee1ccc07b85cbca95abb36205dfdace5e5aeef58adc26166ca5c7b: Status 404 returned error can't find the container with id c2ce71c47eee1ccc07b85cbca95abb36205dfdace5e5aeef58adc26166ca5c7b Jul 06 20:50:45.716069 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:45.716024 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" event={"ID":"996eb26e-3964-4408-b19b-dc22f09e9cfa","Type":"ContainerStarted","Data":"e66dc1de5e1b54483916422dea48ae7b27a1c5ddc440bbbb145df4b1933ac3d6"} Jul 06 20:50:45.717555 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:45.717514 2586 generic.go:356] "Generic (PLEG): container finished" podID="eb3675c5-0128-4724-a601-e70d773a29d3" containerID="e213bbe2c42b64ac75f7371a946ca45ccbdbee5760156c6719416116fbfa405d" exitCode=0 Jul 06 20:50:45.717677 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:45.717577 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k88pb" event={"ID":"eb3675c5-0128-4724-a601-e70d773a29d3","Type":"ContainerDied","Data":"e213bbe2c42b64ac75f7371a946ca45ccbdbee5760156c6719416116fbfa405d"} Jul 06 20:50:45.718815 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:45.718793 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4422643e-bc25-48bf-a8fb-ae7a4bb17b81","Type":"ContainerStarted","Data":"c2ce71c47eee1ccc07b85cbca95abb36205dfdace5e5aeef58adc26166ca5c7b"} Jul 06 20:50:45.725163 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:45.725019 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" event={"ID":"a4d8713b-e22f-4b14-9f60-0d3828631a89","Type":"ContainerStarted","Data":"2135387f39b022d70d83801a33ad29c2f2f6b897f2b8f25bc2dc998575fe2086"} Jul 06 20:50:45.725475 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:45.725454 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" event={"ID":"a4d8713b-e22f-4b14-9f60-0d3828631a89","Type":"ContainerStarted","Data":"ef5c5d2291fde45abf8939ed969d5da4cce8ac523219a62bdf74a963a2aa46a4"} Jul 06 20:50:45.725515 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:45.725489 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" event={"ID":"a4d8713b-e22f-4b14-9f60-0d3828631a89","Type":"ContainerStarted","Data":"fa7c1dc890cb70a93cc02c5827ce8a41654c94909c816b24b7761cceaab15d1e"} Jul 06 20:50:45.738507 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:45.738456 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jr8km" podStartSLOduration=2.349781034 podStartE2EDuration="3.738440068s" totalImagesPullingTime="1.388659034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:45.738328936 +0000 UTC m=+127.072145460" watchObservedRunningTime="2026-07-06 20:50:45.738440068 +0000 UTC m=+127.072256581" Jul 06 20:50:45.772241 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:45.772187 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8sdtb" podStartSLOduration=2.303169162 podStartE2EDuration="3.772165368s" totalImagesPullingTime="1.468996206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:45.770305173 +0000 UTC m=+127.104121684" watchObservedRunningTime="2026-07-06 20:50:45.772165368 +0000 UTC m=+127.105981883" Jul 06 20:50:46.731128 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:46.731062 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k88pb" event={"ID":"eb3675c5-0128-4724-a601-e70d773a29d3","Type":"ContainerStarted","Data":"7f91fa20e23b21a68a3f5c667c42174ff89d454f928fbfaac98e6989aee0413b"} Jul 06 20:50:46.731542 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:46.731152 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k88pb" event={"ID":"eb3675c5-0128-4724-a601-e70d773a29d3","Type":"ContainerStarted","Data":"4880a31eae07b8412a20c921f381c21bd089654b7740672d186df975b581d09f"} Jul 06 20:50:46.732551 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:46.732525 2586 generic.go:356] "Generic (PLEG): container finished" podID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerID="36988f20e75ce923c64d68e54bdabcd2871810017bfe97c10c61f6c0426ad282" exitCode=0 Jul 06 20:50:46.732669 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:46.732609 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4422643e-bc25-48bf-a8fb-ae7a4bb17b81","Type":"ContainerDied","Data":"36988f20e75ce923c64d68e54bdabcd2871810017bfe97c10c61f6c0426ad282"} Jul 06 20:50:46.755426 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:46.755376 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k88pb" podStartSLOduration=3.073887657 podStartE2EDuration="4.755359753s" totalImagesPullingTime="1.615736244s" totalInitContainerRuntime="65.735852ms" isStatefulPod=true podCreationTimestamp="2026-07-06 20:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:46.754158139 +0000 UTC m=+128.087974652" watchObservedRunningTime="2026-07-06 20:50:46.755359753 +0000 UTC m=+128.089176264" Jul 06 20:50:48.748823 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:48.748785 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4422643e-bc25-48bf-a8fb-ae7a4bb17b81","Type":"ContainerStarted","Data":"2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2"} Jul 06 20:50:48.749203 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:48.748873 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4422643e-bc25-48bf-a8fb-ae7a4bb17b81","Type":"ContainerStarted","Data":"7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141"} Jul 06 20:50:48.749203 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:48.748901 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4422643e-bc25-48bf-a8fb-ae7a4bb17b81","Type":"ContainerStarted","Data":"f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a"} Jul 06 20:50:48.749203 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:48.748924 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4422643e-bc25-48bf-a8fb-ae7a4bb17b81","Type":"ContainerStarted","Data":"19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e"} Jul 06 20:50:48.749203 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:48.748947 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4422643e-bc25-48bf-a8fb-ae7a4bb17b81","Type":"ContainerStarted","Data":"6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c"} Jul 06 20:50:48.968524 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:48.968419 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs\") pod \"network-metrics-daemon-f7qm4\" (UID: \"014fb632-7183-4ad8-a74e-838a8d162eef\") " pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:50:48.971005 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:48.970978 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/014fb632-7183-4ad8-a74e-838a8d162eef-metrics-certs\") pod \"network-metrics-daemon-f7qm4\" (UID: \"014fb632-7183-4ad8-a74e-838a8d162eef\") " pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:50:49.127813 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.127782 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-njzmz\"" Jul 06 20:50:49.134205 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.134174 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7qm4" Jul 06 20:50:49.305433 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.305407 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:50:49.309377 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.309353 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.312402 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.312373 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 20:50:49.312741 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.312719 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 20:50:49.312910 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.312728 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 20:50:49.312999 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.312983 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 20:50:49.313576 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.313369 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 20:50:49.313576 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.313384 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 20:50:49.313576 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.313435 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 20:50:49.313576 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.313455 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 20:50:49.313816 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.313679 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 20:50:49.313816 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.313700 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 20:50:49.313816 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.313810 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 20:50:49.313966 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.313840 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6dpb2\"" Jul 06 20:50:49.314380 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.314363 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 20:50:49.314774 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.314397 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1m5kkm0mrvgqv\"" Jul 06 20:50:49.314774 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.314602 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 20:50:49.317020 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.316888 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 20:50:49.321463 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.321442 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 20:50:49.337970 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.337940 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:50:49.356449 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.356341 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f7qm4"] Jul 06 20:50:49.359056 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:50:49.359032 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod014fb632_7183_4ad8_a74e_838a8d162eef.slice/crio-2f6d7731fb3481d915f6e6f90e2f12f453ead34d0b2f85f3dd99a3136ad3db67 WatchSource:0}: Error finding container 2f6d7731fb3481d915f6e6f90e2f12f453ead34d0b2f85f3dd99a3136ad3db67: Status 404 returned error can't find the container with id 2f6d7731fb3481d915f6e6f90e2f12f453ead34d0b2f85f3dd99a3136ad3db67 Jul 06 20:50:49.372135 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372108 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b99800a-b5fe-4697-8376-cdf8a50b69d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372235 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372144 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372235 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372163 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372235 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372194 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-config\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372364 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372233 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372364 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372277 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372364 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372313 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372364 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372335 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372369 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372392 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b99800a-b5fe-4697-8376-cdf8a50b69d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372440 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372477 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372506 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372495 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372677 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372521 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvhpl\" (UniqueName: \"kubernetes.io/projected/4b99800a-b5fe-4697-8376-cdf8a50b69d2-kube-api-access-bvhpl\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372677 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372549 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372677 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372564 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372677 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372581 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372677 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372596 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372677 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372611 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.372677 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.372629 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.423870 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.423834 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59f6cb6fc6-x4p42"] Jul 06 20:50:49.473227 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.473189 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.473227 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.473228 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.473505 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.473252 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.473505 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.473277 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.473505 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.473299 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.473505 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.473331 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b99800a-b5fe-4697-8376-cdf8a50b69d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.473505 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.473358 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.473505 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.473380 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.473505 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.473431 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-config\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.473505 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.473462 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.473505 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.473494 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.473883 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.473521 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.473883 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.473545 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.474113 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.474088 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.474301 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.474278 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.474407 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.474386 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.478375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.474670 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.478375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.474713 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b99800a-b5fe-4697-8376-cdf8a50b69d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.478375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.474760 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.478375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.474806 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.478375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.474843 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.478375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.474875 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvhpl\" (UniqueName: \"kubernetes.io/projected/4b99800a-b5fe-4697-8376-cdf8a50b69d2-kube-api-access-bvhpl\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.478375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.474937 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.478375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.475521 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.478375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.476370 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.478375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.476675 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.478375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.477052 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.478375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.477880 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.478375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.478376 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.479131 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.478486 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.479131 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.478718 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b99800a-b5fe-4697-8376-cdf8a50b69d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.479245 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.479200 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.479401 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.479348 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.479740 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.479719 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b99800a-b5fe-4697-8376-cdf8a50b69d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.480058 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.480032 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.480166 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.480128 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-config\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.480223 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.480162 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.480578 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.480561 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.481298 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.481281 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.487884 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.487863 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvhpl\" (UniqueName: \"kubernetes.io/projected/4b99800a-b5fe-4697-8376-cdf8a50b69d2-kube-api-access-bvhpl\") pod \"prometheus-k8s-0\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.634907 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.634801 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:50:49.757861 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.757687 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4422643e-bc25-48bf-a8fb-ae7a4bb17b81","Type":"ContainerStarted","Data":"eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc"} Jul 06 20:50:49.763311 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.763278 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f7qm4" event={"ID":"014fb632-7183-4ad8-a74e-838a8d162eef","Type":"ContainerStarted","Data":"2f6d7731fb3481d915f6e6f90e2f12f453ead34d0b2f85f3dd99a3136ad3db67"} Jul 06 20:50:49.784042 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.784019 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:50:49.786467 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:50:49.786436 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b99800a_b5fe_4697_8376_cdf8a50b69d2.slice/crio-0a810dd9e756fa2cd207b398791f41f9d98395a65b1da5fcbaf7baac8614758c WatchSource:0}: Error finding container 0a810dd9e756fa2cd207b398791f41f9d98395a65b1da5fcbaf7baac8614758c: Status 404 returned error can't find the container with id 0a810dd9e756fa2cd207b398791f41f9d98395a65b1da5fcbaf7baac8614758c Jul 06 20:50:49.789718 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:49.789665 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.610365757 podStartE2EDuration="5.789649367s" totalImagesPullingTime="3.162551766s" totalInitContainerRuntime="16.731844ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:50:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:49.788103717 +0000 UTC m=+131.121920230" watchObservedRunningTime="2026-07-06 20:50:49.789649367 +0000 UTC m=+131.123465879" Jul 06 20:50:50.769053 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:50.769013 2586 generic.go:356] "Generic (PLEG): container finished" podID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerID="6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91" exitCode=0 Jul 06 20:50:50.769461 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:50.769107 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b99800a-b5fe-4697-8376-cdf8a50b69d2","Type":"ContainerDied","Data":"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91"} Jul 06 20:50:50.769461 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:50.769179 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b99800a-b5fe-4697-8376-cdf8a50b69d2","Type":"ContainerStarted","Data":"0a810dd9e756fa2cd207b398791f41f9d98395a65b1da5fcbaf7baac8614758c"} Jul 06 20:50:50.771128 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:50.771101 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f7qm4" event={"ID":"014fb632-7183-4ad8-a74e-838a8d162eef","Type":"ContainerStarted","Data":"4fb1a9c2a04cbaee648103f082e9fdeb55575c384f704d2b0fe925639f09d708"} Jul 06 20:50:50.771207 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:50.771164 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f7qm4" event={"ID":"014fb632-7183-4ad8-a74e-838a8d162eef","Type":"ContainerStarted","Data":"9222848e81124ffb8f09f7f9a5595c7d1518b7245bce91450260fbafa294ad05"} Jul 06 20:50:53.794414 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:53.794370 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b99800a-b5fe-4697-8376-cdf8a50b69d2","Type":"ContainerStarted","Data":"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72"} Jul 06 20:50:53.794866 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:53.794464 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b99800a-b5fe-4697-8376-cdf8a50b69d2","Type":"ContainerStarted","Data":"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2"} Jul 06 20:50:54.208464 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:54.208427 2586 scope.go:117] "RemoveContainer" containerID="cdf78cd8cae62e13ca4f846f1ffec3a4edca6877bdfd76750494d2b1b388e984" Jul 06 20:50:54.801462 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:54.801437 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fxmcj_5ec4b5d3-3779-4781-809d-da31fe3a5c6c/console-operator/2.log" Jul 06 20:50:54.801931 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:54.801510 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" event={"ID":"5ec4b5d3-3779-4781-809d-da31fe3a5c6c","Type":"ContainerStarted","Data":"1a60b9b8542c3274244d772acdf040f4d1dc9732a981535b5b8c94b891080db5"} Jul 06 20:50:54.802057 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:54.802035 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:50:54.824349 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:54.824291 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f7qm4" podStartSLOduration=134.838500253 podStartE2EDuration="2m15.824270448s" totalImagesPullingTime="985.770195ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:50.841536064 +0000 UTC m=+132.175352576" watchObservedRunningTime="2026-07-06 20:50:54.824270448 +0000 UTC m=+136.158086962" Jul 06 20:50:54.825129 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:54.825089 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" podStartSLOduration=54.477092769 podStartE2EDuration="56.825066213s" totalImagesPullingTime="2.347973444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:49:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:54.822915726 +0000 UTC m=+136.156732249" watchObservedRunningTime="2026-07-06 20:50:54.825066213 +0000 UTC m=+136.158882725" Jul 06 20:50:55.255196 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:55.255169 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-fxmcj" Jul 06 20:50:55.808637 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:55.808544 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b99800a-b5fe-4697-8376-cdf8a50b69d2","Type":"ContainerStarted","Data":"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901"} Jul 06 20:50:55.808637 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:55.808621 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b99800a-b5fe-4697-8376-cdf8a50b69d2","Type":"ContainerStarted","Data":"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321"} Jul 06 20:50:55.809040 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:55.808648 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b99800a-b5fe-4697-8376-cdf8a50b69d2","Type":"ContainerStarted","Data":"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59"} Jul 06 20:50:55.809040 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:55.808679 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b99800a-b5fe-4697-8376-cdf8a50b69d2","Type":"ContainerStarted","Data":"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef"} Jul 06 20:50:55.843173 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:55.843114 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.451457335 podStartE2EDuration="6.843096132s" totalImagesPullingTime="4.36838429s" totalInitContainerRuntime="23.254507ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:50:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:50:55.839429601 +0000 UTC m=+137.173246115" watchObservedRunningTime="2026-07-06 20:50:55.843096132 +0000 UTC m=+137.176912638" Jul 06 20:50:59.635444 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:50:59.635399 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:51:13.879980 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:13.879945 2586 generic.go:356] "Generic (PLEG): container finished" podID="14e83e77-682c-4ed5-b8d9-d4bc425c5b26" containerID="ccb793ea6c0c675315dd106d84bc72a846d188de6dcd6c07c7795830051ab697" exitCode=0 Jul 06 20:51:13.880422 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:13.880029 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94" event={"ID":"14e83e77-682c-4ed5-b8d9-d4bc425c5b26","Type":"ContainerDied","Data":"ccb793ea6c0c675315dd106d84bc72a846d188de6dcd6c07c7795830051ab697"} Jul 06 20:51:13.880422 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:13.880416 2586 scope.go:117] "RemoveContainer" containerID="ccb793ea6c0c675315dd106d84bc72a846d188de6dcd6c07c7795830051ab697" Jul 06 20:51:14.444619 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.444576 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" podUID="0ffde4f3-2adc-4563-a038-14e2232607f8" containerName="registry" containerID="cri-o://a2a3ca531c577c17edd0ce2e240303dc50db5a5739c6f7cf378218c01c7b75f0" gracePeriod=30 Jul 06 20:51:14.704498 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.704435 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:51:14.706538 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.706511 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-certificates\") pod \"0ffde4f3-2adc-4563-a038-14e2232607f8\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " Jul 06 20:51:14.706663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.706650 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls\") pod \"0ffde4f3-2adc-4563-a038-14e2232607f8\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " Jul 06 20:51:14.706709 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.706674 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-bound-sa-token\") pod \"0ffde4f3-2adc-4563-a038-14e2232607f8\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " Jul 06 20:51:14.706709 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.706692 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0ffde4f3-2adc-4563-a038-14e2232607f8-image-registry-private-configuration\") pod \"0ffde4f3-2adc-4563-a038-14e2232607f8\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " Jul 06 20:51:14.706808 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.706724 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0ffde4f3-2adc-4563-a038-14e2232607f8-ca-trust-extracted\") pod \"0ffde4f3-2adc-4563-a038-14e2232607f8\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " Jul 06 20:51:14.706808 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.706752 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctqc6\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-kube-api-access-ctqc6\") pod \"0ffde4f3-2adc-4563-a038-14e2232607f8\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " Jul 06 20:51:14.706909 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.706835 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0ffde4f3-2adc-4563-a038-14e2232607f8-installation-pull-secrets\") pod \"0ffde4f3-2adc-4563-a038-14e2232607f8\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " Jul 06 20:51:14.706909 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.706869 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ffde4f3-2adc-4563-a038-14e2232607f8-trusted-ca\") pod \"0ffde4f3-2adc-4563-a038-14e2232607f8\" (UID: \"0ffde4f3-2adc-4563-a038-14e2232607f8\") " Jul 06 20:51:14.707125 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.706858 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0ffde4f3-2adc-4563-a038-14e2232607f8" (UID: "0ffde4f3-2adc-4563-a038-14e2232607f8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:51:14.707520 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.707481 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ffde4f3-2adc-4563-a038-14e2232607f8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0ffde4f3-2adc-4563-a038-14e2232607f8" (UID: "0ffde4f3-2adc-4563-a038-14e2232607f8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:51:14.709109 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.709041 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0ffde4f3-2adc-4563-a038-14e2232607f8" (UID: "0ffde4f3-2adc-4563-a038-14e2232607f8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:51:14.709310 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.709279 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0ffde4f3-2adc-4563-a038-14e2232607f8" (UID: "0ffde4f3-2adc-4563-a038-14e2232607f8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:51:14.709415 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.709369 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-kube-api-access-ctqc6" (OuterVolumeSpecName: "kube-api-access-ctqc6") pod "0ffde4f3-2adc-4563-a038-14e2232607f8" (UID: "0ffde4f3-2adc-4563-a038-14e2232607f8"). InnerVolumeSpecName "kube-api-access-ctqc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:51:14.709477 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.709448 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ffde4f3-2adc-4563-a038-14e2232607f8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0ffde4f3-2adc-4563-a038-14e2232607f8" (UID: "0ffde4f3-2adc-4563-a038-14e2232607f8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:51:14.709558 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.709536 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ffde4f3-2adc-4563-a038-14e2232607f8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0ffde4f3-2adc-4563-a038-14e2232607f8" (UID: "0ffde4f3-2adc-4563-a038-14e2232607f8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:51:14.715399 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.715372 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ffde4f3-2adc-4563-a038-14e2232607f8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0ffde4f3-2adc-4563-a038-14e2232607f8" (UID: "0ffde4f3-2adc-4563-a038-14e2232607f8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:51:14.807840 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.807808 2586 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0ffde4f3-2adc-4563-a038-14e2232607f8-installation-pull-secrets\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:51:14.807840 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.807836 2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ffde4f3-2adc-4563-a038-14e2232607f8-trusted-ca\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:51:14.807840 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.807845 2586 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-certificates\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:51:14.808139 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.807856 2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-registry-tls\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:51:14.808139 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.807865 2586 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-bound-sa-token\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:51:14.808139 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.807874 2586 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0ffde4f3-2adc-4563-a038-14e2232607f8-image-registry-private-configuration\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:51:14.808139 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.807884 2586 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0ffde4f3-2adc-4563-a038-14e2232607f8-ca-trust-extracted\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:51:14.808139 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.807895 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctqc6\" (UniqueName: \"kubernetes.io/projected/0ffde4f3-2adc-4563-a038-14e2232607f8-kube-api-access-ctqc6\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:51:14.886176 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.886142 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8v94" event={"ID":"14e83e77-682c-4ed5-b8d9-d4bc425c5b26","Type":"ContainerStarted","Data":"1e182a6324d3e859d1808e829095610cf5416c9f182c036db6096c6be0b80293"} Jul 06 20:51:14.887426 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.887401 2586 generic.go:356] "Generic (PLEG): container finished" podID="0ffde4f3-2adc-4563-a038-14e2232607f8" containerID="a2a3ca531c577c17edd0ce2e240303dc50db5a5739c6f7cf378218c01c7b75f0" exitCode=0 Jul 06 20:51:14.887577 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.887436 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" Jul 06 20:51:14.887577 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.887480 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" event={"ID":"0ffde4f3-2adc-4563-a038-14e2232607f8","Type":"ContainerDied","Data":"a2a3ca531c577c17edd0ce2e240303dc50db5a5739c6f7cf378218c01c7b75f0"} Jul 06 20:51:14.887577 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.887534 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f6cb6fc6-x4p42" event={"ID":"0ffde4f3-2adc-4563-a038-14e2232607f8","Type":"ContainerDied","Data":"a9e0adccb937915ecb1fa7d5bc7ce4d3e915ef86f04d493903000b9e3e948f1d"} Jul 06 20:51:14.887577 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.887564 2586 scope.go:117] "RemoveContainer" containerID="a2a3ca531c577c17edd0ce2e240303dc50db5a5739c6f7cf378218c01c7b75f0" Jul 06 20:51:14.903874 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.903840 2586 scope.go:117] "RemoveContainer" containerID="a2a3ca531c577c17edd0ce2e240303dc50db5a5739c6f7cf378218c01c7b75f0" Jul 06 20:51:14.904482 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:51:14.904451 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2a3ca531c577c17edd0ce2e240303dc50db5a5739c6f7cf378218c01c7b75f0\": container with ID starting with a2a3ca531c577c17edd0ce2e240303dc50db5a5739c6f7cf378218c01c7b75f0 not found: ID does not exist" containerID="a2a3ca531c577c17edd0ce2e240303dc50db5a5739c6f7cf378218c01c7b75f0" Jul 06 20:51:14.904605 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.904507 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2a3ca531c577c17edd0ce2e240303dc50db5a5739c6f7cf378218c01c7b75f0"} err="failed to get container status \"a2a3ca531c577c17edd0ce2e240303dc50db5a5739c6f7cf378218c01c7b75f0\": rpc error: code = NotFound desc = could not find container \"a2a3ca531c577c17edd0ce2e240303dc50db5a5739c6f7cf378218c01c7b75f0\": container with ID starting with a2a3ca531c577c17edd0ce2e240303dc50db5a5739c6f7cf378218c01c7b75f0 not found: ID does not exist" Jul 06 20:51:14.922784 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.922752 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59f6cb6fc6-x4p42"] Jul 06 20:51:14.927090 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:14.927051 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59f6cb6fc6-x4p42"] Jul 06 20:51:15.212514 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:15.212488 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ffde4f3-2adc-4563-a038-14e2232607f8" path="/var/lib/kubelet/pods/0ffde4f3-2adc-4563-a038-14e2232607f8/volumes" Jul 06 20:51:49.635019 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:49.634979 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:51:49.654279 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:49.654248 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:51:50.044538 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:51:50.044503 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:03.302775 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:03.302734 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:52:03.303856 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:03.303814 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="alertmanager" containerID="cri-o://6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c" gracePeriod=120 Jul 06 20:52:03.303973 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:03.303911 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="kube-rbac-proxy-metric" containerID="cri-o://2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2" gracePeriod=120 Jul 06 20:52:03.304032 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:03.303964 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="kube-rbac-proxy" containerID="cri-o://7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141" gracePeriod=120 Jul 06 20:52:03.304032 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:03.304019 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="config-reloader" containerID="cri-o://19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e" gracePeriod=120 Jul 06 20:52:03.304176 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:03.303964 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="prom-label-proxy" containerID="cri-o://eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc" gracePeriod=120 Jul 06 20:52:03.304176 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:03.303993 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="kube-rbac-proxy-web" containerID="cri-o://f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a" gracePeriod=120 Jul 06 20:52:04.088334 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.088300 2586 generic.go:356] "Generic (PLEG): container finished" podID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerID="eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc" exitCode=0 Jul 06 20:52:04.088334 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.088326 2586 generic.go:356] "Generic (PLEG): container finished" podID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerID="7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141" exitCode=0 Jul 06 20:52:04.088334 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.088333 2586 generic.go:356] "Generic (PLEG): container finished" podID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerID="19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e" exitCode=0 Jul 06 20:52:04.088334 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.088341 2586 generic.go:356] "Generic (PLEG): container finished" podID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerID="6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c" exitCode=0 Jul 06 20:52:04.088596 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.088362 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4422643e-bc25-48bf-a8fb-ae7a4bb17b81","Type":"ContainerDied","Data":"eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc"} Jul 06 20:52:04.088596 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.088432 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4422643e-bc25-48bf-a8fb-ae7a4bb17b81","Type":"ContainerDied","Data":"7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141"} Jul 06 20:52:04.088596 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.088462 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4422643e-bc25-48bf-a8fb-ae7a4bb17b81","Type":"ContainerDied","Data":"19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e"} Jul 06 20:52:04.088596 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.088489 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4422643e-bc25-48bf-a8fb-ae7a4bb17b81","Type":"ContainerDied","Data":"6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c"} Jul 06 20:52:04.560928 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.560899 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:04.646584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.646478 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxg24\" (UniqueName: \"kubernetes.io/projected/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-kube-api-access-jxg24\") pod \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " Jul 06 20:52:04.646584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.646531 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-web-config\") pod \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " Jul 06 20:52:04.646584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.646560 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-cluster-tls-config\") pod \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " Jul 06 20:52:04.646914 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.646895 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-config-out\") pod \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " Jul 06 20:52:04.646987 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.646946 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy-web\") pod \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " Jul 06 20:52:04.646987 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.646973 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-config-volume\") pod \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " Jul 06 20:52:04.647108 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.647001 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-tls-assets\") pod \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " Jul 06 20:52:04.647108 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.647069 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-metrics-client-ca\") pod \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " Jul 06 20:52:04.647213 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.647124 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " Jul 06 20:52:04.647213 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.647165 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-main-tls\") pod \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " Jul 06 20:52:04.647213 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.647202 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-alertmanager-main-db\") pod \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " Jul 06 20:52:04.647357 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.647229 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy\") pod \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " Jul 06 20:52:04.647357 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.647258 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-alertmanager-trusted-ca-bundle\") pod \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\" (UID: \"4422643e-bc25-48bf-a8fb-ae7a4bb17b81\") " Jul 06 20:52:04.648390 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.648121 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4422643e-bc25-48bf-a8fb-ae7a4bb17b81" (UID: "4422643e-bc25-48bf-a8fb-ae7a4bb17b81"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:52:04.648390 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.648272 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4422643e-bc25-48bf-a8fb-ae7a4bb17b81" (UID: "4422643e-bc25-48bf-a8fb-ae7a4bb17b81"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:52:04.648666 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.648639 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4422643e-bc25-48bf-a8fb-ae7a4bb17b81" (UID: "4422643e-bc25-48bf-a8fb-ae7a4bb17b81"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:52:04.649514 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.649484 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-kube-api-access-jxg24" (OuterVolumeSpecName: "kube-api-access-jxg24") pod "4422643e-bc25-48bf-a8fb-ae7a4bb17b81" (UID: "4422643e-bc25-48bf-a8fb-ae7a4bb17b81"). InnerVolumeSpecName "kube-api-access-jxg24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:52:04.651318 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.651279 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4422643e-bc25-48bf-a8fb-ae7a4bb17b81" (UID: "4422643e-bc25-48bf-a8fb-ae7a4bb17b81"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:52:04.651443 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.651376 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-config-volume" (OuterVolumeSpecName: "config-volume") pod "4422643e-bc25-48bf-a8fb-ae7a4bb17b81" (UID: "4422643e-bc25-48bf-a8fb-ae7a4bb17b81"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:52:04.651807 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.651770 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-config-out" (OuterVolumeSpecName: "config-out") pod "4422643e-bc25-48bf-a8fb-ae7a4bb17b81" (UID: "4422643e-bc25-48bf-a8fb-ae7a4bb17b81"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:52:04.651889 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.651817 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4422643e-bc25-48bf-a8fb-ae7a4bb17b81" (UID: "4422643e-bc25-48bf-a8fb-ae7a4bb17b81"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:52:04.652262 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.652242 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4422643e-bc25-48bf-a8fb-ae7a4bb17b81" (UID: "4422643e-bc25-48bf-a8fb-ae7a4bb17b81"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:52:04.652340 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.652305 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4422643e-bc25-48bf-a8fb-ae7a4bb17b81" (UID: "4422643e-bc25-48bf-a8fb-ae7a4bb17b81"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:52:04.652855 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.652825 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4422643e-bc25-48bf-a8fb-ae7a4bb17b81" (UID: "4422643e-bc25-48bf-a8fb-ae7a4bb17b81"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:52:04.655247 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.655178 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4422643e-bc25-48bf-a8fb-ae7a4bb17b81" (UID: "4422643e-bc25-48bf-a8fb-ae7a4bb17b81"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:52:04.662096 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.662056 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-web-config" (OuterVolumeSpecName: "web-config") pod "4422643e-bc25-48bf-a8fb-ae7a4bb17b81" (UID: "4422643e-bc25-48bf-a8fb-ae7a4bb17b81"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:52:04.748663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.748626 2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:04.748663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.748659 2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-main-tls\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:04.748663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.748673 2586 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-alertmanager-main-db\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:04.748890 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.748682 2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:04.748890 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.748692 2586 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:04.748890 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.748701 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxg24\" (UniqueName: \"kubernetes.io/projected/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-kube-api-access-jxg24\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:04.748890 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.748710 2586 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-web-config\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:04.748890 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.748719 2586 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-cluster-tls-config\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:04.748890 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.748727 2586 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-config-out\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:04.748890 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.748735 2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:04.748890 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.748743 2586 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-config-volume\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:04.748890 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.748751 2586 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-tls-assets\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:04.748890 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:04.748759 2586 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4422643e-bc25-48bf-a8fb-ae7a4bb17b81-metrics-client-ca\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:05.095048 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.095011 2586 generic.go:356] "Generic (PLEG): container finished" podID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerID="2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2" exitCode=0 Jul 06 20:52:05.095048 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.095044 2586 generic.go:356] "Generic (PLEG): container finished" podID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerID="f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a" exitCode=0 Jul 06 20:52:05.095285 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.095102 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.095285 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.095108 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4422643e-bc25-48bf-a8fb-ae7a4bb17b81","Type":"ContainerDied","Data":"2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2"} Jul 06 20:52:05.095285 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.095181 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4422643e-bc25-48bf-a8fb-ae7a4bb17b81","Type":"ContainerDied","Data":"f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a"} Jul 06 20:52:05.095285 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.095210 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4422643e-bc25-48bf-a8fb-ae7a4bb17b81","Type":"ContainerDied","Data":"c2ce71c47eee1ccc07b85cbca95abb36205dfdace5e5aeef58adc26166ca5c7b"} Jul 06 20:52:05.095285 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.095240 2586 scope.go:117] "RemoveContainer" containerID="eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc" Jul 06 20:52:05.103652 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.103630 2586 scope.go:117] "RemoveContainer" containerID="2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2" Jul 06 20:52:05.111280 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.111257 2586 scope.go:117] "RemoveContainer" containerID="7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141" Jul 06 20:52:05.118549 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.118518 2586 scope.go:117] "RemoveContainer" containerID="f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a" Jul 06 20:52:05.123404 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.123375 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:52:05.127915 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.127892 2586 scope.go:117] "RemoveContainer" containerID="19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e" Jul 06 20:52:05.128347 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.128326 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:52:05.135431 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.135412 2586 scope.go:117] "RemoveContainer" containerID="6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c" Jul 06 20:52:05.143221 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.143200 2586 scope.go:117] "RemoveContainer" containerID="36988f20e75ce923c64d68e54bdabcd2871810017bfe97c10c61f6c0426ad282" Jul 06 20:52:05.150310 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.150287 2586 scope.go:117] "RemoveContainer" containerID="eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc" Jul 06 20:52:05.150618 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:52:05.150597 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc\": container with ID starting with eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc not found: ID does not exist" containerID="eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc" Jul 06 20:52:05.150718 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.150627 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc"} err="failed to get container status \"eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc\": rpc error: code = NotFound desc = could not find container \"eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc\": container with ID starting with eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc not found: ID does not exist" Jul 06 20:52:05.150718 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.150646 2586 scope.go:117] "RemoveContainer" containerID="2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2" Jul 06 20:52:05.150871 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:52:05.150856 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2\": container with ID starting with 2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2 not found: ID does not exist" containerID="2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2" Jul 06 20:52:05.150918 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.150876 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2"} err="failed to get container status \"2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2\": rpc error: code = NotFound desc = could not find container \"2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2\": container with ID starting with 2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2 not found: ID does not exist" Jul 06 20:52:05.150918 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.150891 2586 scope.go:117] "RemoveContainer" containerID="7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141" Jul 06 20:52:05.151130 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:52:05.151110 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141\": container with ID starting with 7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141 not found: ID does not exist" containerID="7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141" Jul 06 20:52:05.151191 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.151134 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141"} err="failed to get container status \"7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141\": rpc error: code = NotFound desc = could not find container \"7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141\": container with ID starting with 7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141 not found: ID does not exist" Jul 06 20:52:05.151191 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.151147 2586 scope.go:117] "RemoveContainer" containerID="f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a" Jul 06 20:52:05.151377 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:52:05.151361 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a\": container with ID starting with f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a not found: ID does not exist" containerID="f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a" Jul 06 20:52:05.151416 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.151380 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a"} err="failed to get container status \"f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a\": rpc error: code = NotFound desc = could not find container \"f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a\": container with ID starting with f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a not found: ID does not exist" Jul 06 20:52:05.151416 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.151392 2586 scope.go:117] "RemoveContainer" containerID="19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e" Jul 06 20:52:05.151616 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:52:05.151598 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e\": container with ID starting with 19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e not found: ID does not exist" containerID="19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e" Jul 06 20:52:05.151654 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.151622 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e"} err="failed to get container status \"19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e\": rpc error: code = NotFound desc = could not find container \"19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e\": container with ID starting with 19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e not found: ID does not exist" Jul 06 20:52:05.151654 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.151638 2586 scope.go:117] "RemoveContainer" containerID="6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c" Jul 06 20:52:05.151876 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:52:05.151858 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c\": container with ID starting with 6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c not found: ID does not exist" containerID="6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c" Jul 06 20:52:05.152024 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.151878 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c"} err="failed to get container status \"6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c\": rpc error: code = NotFound desc = could not find container \"6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c\": container with ID starting with 6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c not found: ID does not exist" Jul 06 20:52:05.152024 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.151892 2586 scope.go:117] "RemoveContainer" containerID="36988f20e75ce923c64d68e54bdabcd2871810017bfe97c10c61f6c0426ad282" Jul 06 20:52:05.152461 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:52:05.152426 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36988f20e75ce923c64d68e54bdabcd2871810017bfe97c10c61f6c0426ad282\": container with ID starting with 36988f20e75ce923c64d68e54bdabcd2871810017bfe97c10c61f6c0426ad282 not found: ID does not exist" containerID="36988f20e75ce923c64d68e54bdabcd2871810017bfe97c10c61f6c0426ad282" Jul 06 20:52:05.152560 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.152457 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36988f20e75ce923c64d68e54bdabcd2871810017bfe97c10c61f6c0426ad282"} err="failed to get container status \"36988f20e75ce923c64d68e54bdabcd2871810017bfe97c10c61f6c0426ad282\": rpc error: code = NotFound desc = could not find container \"36988f20e75ce923c64d68e54bdabcd2871810017bfe97c10c61f6c0426ad282\": container with ID starting with 36988f20e75ce923c64d68e54bdabcd2871810017bfe97c10c61f6c0426ad282 not found: ID does not exist" Jul 06 20:52:05.152560 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.152479 2586 scope.go:117] "RemoveContainer" containerID="eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc" Jul 06 20:52:05.152800 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.152780 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc"} err="failed to get container status \"eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc\": rpc error: code = NotFound desc = could not find container \"eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc\": container with ID starting with eb8f17a990e158034676bff208596258c7dc09716336787fa2bcb3f659903dbc not found: ID does not exist" Jul 06 20:52:05.152854 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.152801 2586 scope.go:117] "RemoveContainer" containerID="2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2" Jul 06 20:52:05.153031 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.153008 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2"} err="failed to get container status \"2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2\": rpc error: code = NotFound desc = could not find container \"2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2\": container with ID starting with 2dc9ff0bec40f205a54d9fe1de552d8742d53000b9da3cfed4d7459b142499e2 not found: ID does not exist" Jul 06 20:52:05.153031 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.153031 2586 scope.go:117] "RemoveContainer" containerID="7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141" Jul 06 20:52:05.153239 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.153224 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141"} err="failed to get container status \"7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141\": rpc error: code = NotFound desc = could not find container \"7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141\": container with ID starting with 7ad85790ef2d1e2896848f473c03bdb2dedf8f378cdf61ca99849c540c388141 not found: ID does not exist" Jul 06 20:52:05.153239 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.153240 2586 scope.go:117] "RemoveContainer" containerID="f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a" Jul 06 20:52:05.153447 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.153433 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a"} err="failed to get container status \"f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a\": rpc error: code = NotFound desc = could not find container \"f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a\": container with ID starting with f9dfdbc1491158ca8c595615e4c62261826a24bce42f93e7d0f529fa4867cc3a not found: ID does not exist" Jul 06 20:52:05.153447 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.153446 2586 scope.go:117] "RemoveContainer" containerID="19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e" Jul 06 20:52:05.153651 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.153630 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e"} err="failed to get container status \"19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e\": rpc error: code = NotFound desc = could not find container \"19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e\": container with ID starting with 19761f6b858a49e2f7a3691b43d77ef0d99263c06f90c7f32a1a2ffe2c364a3e not found: ID does not exist" Jul 06 20:52:05.153728 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.153651 2586 scope.go:117] "RemoveContainer" containerID="6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c" Jul 06 20:52:05.153858 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.153842 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c"} err="failed to get container status \"6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c\": rpc error: code = NotFound desc = could not find container \"6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c\": container with ID starting with 6ef8a4552fbc42715878bb46f26abf02dc0fdd61cca63ccd9986831135ee1f5c not found: ID does not exist" Jul 06 20:52:05.153901 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.153858 2586 scope.go:117] "RemoveContainer" containerID="36988f20e75ce923c64d68e54bdabcd2871810017bfe97c10c61f6c0426ad282" Jul 06 20:52:05.154091 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.154053 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36988f20e75ce923c64d68e54bdabcd2871810017bfe97c10c61f6c0426ad282"} err="failed to get container status \"36988f20e75ce923c64d68e54bdabcd2871810017bfe97c10c61f6c0426ad282\": rpc error: code = NotFound desc = could not find container \"36988f20e75ce923c64d68e54bdabcd2871810017bfe97c10c61f6c0426ad282\": container with ID starting with 36988f20e75ce923c64d68e54bdabcd2871810017bfe97c10c61f6c0426ad282 not found: ID does not exist" Jul 06 20:52:05.162570 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.162547 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:52:05.162932 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.162914 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="kube-rbac-proxy" Jul 06 20:52:05.163011 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.162935 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="kube-rbac-proxy" Jul 06 20:52:05.163011 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.162949 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="alertmanager" Jul 06 20:52:05.163011 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.162957 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="alertmanager" Jul 06 20:52:05.163011 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.162968 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="kube-rbac-proxy-metric" Jul 06 20:52:05.163011 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.162977 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="kube-rbac-proxy-metric" Jul 06 20:52:05.163011 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.162991 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="prom-label-proxy" Jul 06 20:52:05.163011 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.163000 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="prom-label-proxy" Jul 06 20:52:05.163375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.163018 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="init-config-reloader" Jul 06 20:52:05.163375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.163026 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="init-config-reloader" Jul 06 20:52:05.163375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.163036 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ffde4f3-2adc-4563-a038-14e2232607f8" containerName="registry" Jul 06 20:52:05.163375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.163046 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ffde4f3-2adc-4563-a038-14e2232607f8" containerName="registry" Jul 06 20:52:05.163375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.163063 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="config-reloader" Jul 06 20:52:05.163375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.163071 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="config-reloader" Jul 06 20:52:05.163375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.163099 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="kube-rbac-proxy-web" Jul 06 20:52:05.163375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.163107 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="kube-rbac-proxy-web" Jul 06 20:52:05.163375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.163190 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="kube-rbac-proxy" Jul 06 20:52:05.163375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.163204 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="kube-rbac-proxy-web" Jul 06 20:52:05.163375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.163213 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="kube-rbac-proxy-metric" Jul 06 20:52:05.163375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.163222 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="prom-label-proxy" Jul 06 20:52:05.163375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.163232 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="alertmanager" Jul 06 20:52:05.163375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.163244 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ffde4f3-2adc-4563-a038-14e2232607f8" containerName="registry" Jul 06 20:52:05.163375 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.163253 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" containerName="config-reloader" Jul 06 20:52:05.168396 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.168377 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.171133 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.171111 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 20:52:05.171234 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.171207 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 20:52:05.171295 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.171208 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6ctns\"" Jul 06 20:52:05.171461 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.171425 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 20:52:05.171551 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.171468 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 20:52:05.171551 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.171480 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 20:52:05.171551 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.171425 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 20:52:05.171551 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.171508 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 20:52:05.171740 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.171432 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 20:52:05.177088 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.177051 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 20:52:05.182164 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.182140 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:52:05.212659 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.212621 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4422643e-bc25-48bf-a8fb-ae7a4bb17b81" path="/var/lib/kubelet/pods/4422643e-bc25-48bf-a8fb-ae7a4bb17b81/volumes" Jul 06 20:52:05.251396 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.251358 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d485bb4e-f676-41c1-88fa-7721371121d8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.251396 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.251402 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d485bb4e-f676-41c1-88fa-7721371121d8-config-out\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.251617 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.251430 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.251617 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.251511 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-config-volume\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.251617 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.251540 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-web-config\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.251617 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.251560 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d485bb4e-f676-41c1-88fa-7721371121d8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.251739 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.251624 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.251739 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.251652 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l447l\" (UniqueName: \"kubernetes.io/projected/d485bb4e-f676-41c1-88fa-7721371121d8-kube-api-access-l447l\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.251739 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.251674 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.251739 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.251700 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.251739 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.251723 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.251886 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.251741 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d485bb4e-f676-41c1-88fa-7721371121d8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.251886 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.251755 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d485bb4e-f676-41c1-88fa-7721371121d8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.352203 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.352123 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-config-volume\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.352203 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.352156 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-web-config\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.352203 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.352174 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d485bb4e-f676-41c1-88fa-7721371121d8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.352454 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.352208 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.352454 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.352233 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l447l\" (UniqueName: \"kubernetes.io/projected/d485bb4e-f676-41c1-88fa-7721371121d8-kube-api-access-l447l\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.352454 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.352266 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.352454 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.352302 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.352454 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.352326 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.352454 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.352356 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d485bb4e-f676-41c1-88fa-7721371121d8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.352454 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.352377 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d485bb4e-f676-41c1-88fa-7721371121d8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.352454 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.352402 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d485bb4e-f676-41c1-88fa-7721371121d8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.352454 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.352436 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d485bb4e-f676-41c1-88fa-7721371121d8-config-out\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.352883 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.352492 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.355473 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.355332 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-config-volume\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.355473 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.355456 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.355649 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.355505 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.355740 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.355718 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d485bb4e-f676-41c1-88fa-7721371121d8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.355795 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.355736 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-web-config\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.356013 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.355991 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d485bb4e-f676-41c1-88fa-7721371121d8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.356529 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.356151 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d485bb4e-f676-41c1-88fa-7721371121d8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.356529 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.355496 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.357585 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.357555 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d485bb4e-f676-41c1-88fa-7721371121d8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.360836 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.357951 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d485bb4e-f676-41c1-88fa-7721371121d8-config-out\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.360836 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.358645 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.360836 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.358912 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d485bb4e-f676-41c1-88fa-7721371121d8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.365824 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.365800 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l447l\" (UniqueName: \"kubernetes.io/projected/d485bb4e-f676-41c1-88fa-7721371121d8-kube-api-access-l447l\") pod \"alertmanager-main-0\" (UID: \"d485bb4e-f676-41c1-88fa-7721371121d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.478174 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.478117 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:52:05.628936 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:05.628911 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:52:05.630716 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:52:05.630683 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd485bb4e_f676_41c1_88fa_7721371121d8.slice/crio-0a854d648d79600fdeab2d08304f5d6548162c57f431d40e5c4a9c748bd995c0 WatchSource:0}: Error finding container 0a854d648d79600fdeab2d08304f5d6548162c57f431d40e5c4a9c748bd995c0: Status 404 returned error can't find the container with id 0a854d648d79600fdeab2d08304f5d6548162c57f431d40e5c4a9c748bd995c0 Jul 06 20:52:06.101791 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:06.101754 2586 generic.go:356] "Generic (PLEG): container finished" podID="d485bb4e-f676-41c1-88fa-7721371121d8" containerID="09ae5bbef37afdea40734dadb488c5358b8eb92651c257401039b6e9b42e686e" exitCode=0 Jul 06 20:52:06.101967 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:06.101813 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d485bb4e-f676-41c1-88fa-7721371121d8","Type":"ContainerDied","Data":"09ae5bbef37afdea40734dadb488c5358b8eb92651c257401039b6e9b42e686e"} Jul 06 20:52:06.101967 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:06.101860 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d485bb4e-f676-41c1-88fa-7721371121d8","Type":"ContainerStarted","Data":"0a854d648d79600fdeab2d08304f5d6548162c57f431d40e5c4a9c748bd995c0"} Jul 06 20:52:07.109265 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.109230 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d485bb4e-f676-41c1-88fa-7721371121d8","Type":"ContainerStarted","Data":"e0dc2fbe3c70547c9ab694619a4de3da270f1604e8b35d81ba7d882ddc3d4be6"} Jul 06 20:52:07.109645 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.109294 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d485bb4e-f676-41c1-88fa-7721371121d8","Type":"ContainerStarted","Data":"605a962d73b0dbb257628f9e210156ae63ad64ea9fa56d395dcc435e7fc0b8ef"} Jul 06 20:52:07.109645 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.109324 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d485bb4e-f676-41c1-88fa-7721371121d8","Type":"ContainerStarted","Data":"0b1addb51753f82a84eb00ed60488a5dd16fa85ce3ec960f582a2e63030dae5b"} Jul 06 20:52:07.109645 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.109348 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d485bb4e-f676-41c1-88fa-7721371121d8","Type":"ContainerStarted","Data":"2babce61204d381a3b1e8ed5d3c942740b5c9a0470269e3c9ab672963281da5c"} Jul 06 20:52:07.109645 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.109372 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d485bb4e-f676-41c1-88fa-7721371121d8","Type":"ContainerStarted","Data":"d2ebbe0103a3baeae4bd8604e7eec4b066ceb01024fd21205ef2768c5c6e02e0"} Jul 06 20:52:07.109645 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.109394 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d485bb4e-f676-41c1-88fa-7721371121d8","Type":"ContainerStarted","Data":"284609ccaa0ec087e4fda8d094bba43709dc85d90b635fbd42d2e8ca7169464f"} Jul 06 20:52:07.145066 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.144826 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.129687969 podStartE2EDuration="2.144805755s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.117786ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:52:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:52:07.143164782 +0000 UTC m=+208.476981293" watchObservedRunningTime="2026-07-06 20:52:07.144805755 +0000 UTC m=+208.478622266" Jul 06 20:52:07.331342 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.331302 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj"] Jul 06 20:52:07.334702 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.334681 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.337243 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.337226 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 20:52:07.337392 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.337373 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6wsdt\"" Jul 06 20:52:07.337830 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.337815 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 20:52:07.338163 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.338148 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 20:52:07.339109 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.339070 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 20:52:07.339227 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.339207 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 20:52:07.343227 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.343205 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 20:52:07.361212 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.361123 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj"] Jul 06 20:52:07.370365 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.370330 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d9b29353-5be0-4275-85c1-52686e36de42-telemeter-client-tls\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.370365 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.370365 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9b29353-5be0-4275-85c1-52686e36de42-metrics-client-ca\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.370618 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.370404 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9b29353-5be0-4275-85c1-52686e36de42-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.370618 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.370446 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9b29353-5be0-4275-85c1-52686e36de42-serving-certs-ca-bundle\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.370618 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.370468 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9b29353-5be0-4275-85c1-52686e36de42-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.370618 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.370485 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d9b29353-5be0-4275-85c1-52686e36de42-federate-client-tls\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.370618 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.370532 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qck8p\" (UniqueName: \"kubernetes.io/projected/d9b29353-5be0-4275-85c1-52686e36de42-kube-api-access-qck8p\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.370618 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.370588 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d9b29353-5be0-4275-85c1-52686e36de42-secret-telemeter-client\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.471586 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.471550 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9b29353-5be0-4275-85c1-52686e36de42-metrics-client-ca\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.471744 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.471604 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9b29353-5be0-4275-85c1-52686e36de42-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.471744 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.471633 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9b29353-5be0-4275-85c1-52686e36de42-serving-certs-ca-bundle\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.471744 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.471657 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9b29353-5be0-4275-85c1-52686e36de42-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.471744 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.471677 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d9b29353-5be0-4275-85c1-52686e36de42-federate-client-tls\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.471744 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.471698 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qck8p\" (UniqueName: \"kubernetes.io/projected/d9b29353-5be0-4275-85c1-52686e36de42-kube-api-access-qck8p\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.471744 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.471729 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d9b29353-5be0-4275-85c1-52686e36de42-secret-telemeter-client\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.472038 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.471878 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d9b29353-5be0-4275-85c1-52686e36de42-telemeter-client-tls\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.472475 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.472445 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9b29353-5be0-4275-85c1-52686e36de42-metrics-client-ca\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.472591 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.472513 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9b29353-5be0-4275-85c1-52686e36de42-serving-certs-ca-bundle\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.472896 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.472870 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9b29353-5be0-4275-85c1-52686e36de42-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.474337 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.474316 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d9b29353-5be0-4275-85c1-52686e36de42-secret-telemeter-client\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.474538 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.474516 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d9b29353-5be0-4275-85c1-52686e36de42-telemeter-client-tls\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.474601 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.474553 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d9b29353-5be0-4275-85c1-52686e36de42-federate-client-tls\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.474601 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.474555 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9b29353-5be0-4275-85c1-52686e36de42-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.480419 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.480393 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qck8p\" (UniqueName: \"kubernetes.io/projected/d9b29353-5be0-4275-85c1-52686e36de42-kube-api-access-qck8p\") pod \"telemeter-client-7bfd5876d4-2v8bj\" (UID: \"d9b29353-5be0-4275-85c1-52686e36de42\") " pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.625071 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.624981 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:52:07.625322 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.625281 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="prometheus" containerID="cri-o://1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2" gracePeriod=600 Jul 06 20:52:07.625465 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.625307 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="kube-rbac-proxy" containerID="cri-o://a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321" gracePeriod=600 Jul 06 20:52:07.625465 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.625327 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="thanos-sidecar" containerID="cri-o://6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef" gracePeriod=600 Jul 06 20:52:07.625465 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.625337 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901" gracePeriod=600 Jul 06 20:52:07.625465 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.625354 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="kube-rbac-proxy-web" containerID="cri-o://262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59" gracePeriod=600 Jul 06 20:52:07.625465 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.625376 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="config-reloader" containerID="cri-o://1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72" gracePeriod=600 Jul 06 20:52:07.645654 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.645624 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" Jul 06 20:52:07.798652 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.798621 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj"] Jul 06 20:52:07.801167 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:52:07.801139 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b29353_5be0_4275_85c1_52686e36de42.slice/crio-24892c90a8a203fc96a3b77252992aa345db0aee7a2f122be05e09a7224610a6 WatchSource:0}: Error finding container 24892c90a8a203fc96a3b77252992aa345db0aee7a2f122be05e09a7224610a6: Status 404 returned error can't find the container with id 24892c90a8a203fc96a3b77252992aa345db0aee7a2f122be05e09a7224610a6 Jul 06 20:52:07.877972 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.877907 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:07.976263 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976218 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-serving-certs-ca-bundle\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.976428 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976275 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.976428 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976312 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-kubelet-serving-ca-bundle\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.976428 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976340 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b99800a-b5fe-4697-8376-cdf8a50b69d2-config-out\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.976428 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976370 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-2\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.976428 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976399 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-metrics-client-ca\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.976748 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976431 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-db\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.976748 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976489 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-tls\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.976748 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976517 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-0\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.976748 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976543 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.976748 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976572 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-grpc-tls\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.976748 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976608 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-web-config\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.976748 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976655 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-config\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.976748 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976680 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-metrics-client-certs\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.976748 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976708 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-trusted-ca-bundle\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.976748 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976738 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-kube-rbac-proxy\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.977257 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976758 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-thanos-prometheus-http-client-file\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.977257 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976779 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b99800a-b5fe-4697-8376-cdf8a50b69d2-tls-assets\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.977257 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976804 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-1\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.977257 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.976829 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvhpl\" (UniqueName: \"kubernetes.io/projected/4b99800a-b5fe-4697-8376-cdf8a50b69d2-kube-api-access-bvhpl\") pod \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\" (UID: \"4b99800a-b5fe-4697-8376-cdf8a50b69d2\") " Jul 06 20:52:07.977470 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.977295 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:52:07.978325 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.978177 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:52:07.978325 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.978249 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:52:07.978325 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.978271 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:52:07.978550 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.978371 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:52:07.979238 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.978968 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:52:07.979238 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.979066 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b99800a-b5fe-4697-8376-cdf8a50b69d2-kube-api-access-bvhpl" (OuterVolumeSpecName: "kube-api-access-bvhpl") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "kube-api-access-bvhpl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:52:07.979418 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.979332 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-config" (OuterVolumeSpecName: "config") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:52:07.979524 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.979399 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b99800a-b5fe-4697-8376-cdf8a50b69d2-config-out" (OuterVolumeSpecName: "config-out") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:52:07.979919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.979853 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:52:07.979919 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.979877 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:52:07.980230 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.980200 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:52:07.980967 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.980922 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:52:07.981064 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.981026 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:52:07.981064 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.981049 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:52:07.981264 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.981061 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:52:07.981585 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.981556 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b99800a-b5fe-4697-8376-cdf8a50b69d2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:52:07.981898 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.981872 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:52:07.982735 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.982717 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:52:07.992271 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:07.992241 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-web-config" (OuterVolumeSpecName: "web-config") pod "4b99800a-b5fe-4697-8376-cdf8a50b69d2" (UID: "4b99800a-b5fe-4697-8376-cdf8a50b69d2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:52:08.078023 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.077972 2586 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-kube-rbac-proxy\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078023 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078017 2586 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078023 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078030 2586 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b99800a-b5fe-4697-8376-cdf8a50b69d2-tls-assets\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078023 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078039 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078300 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078048 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvhpl\" (UniqueName: \"kubernetes.io/projected/4b99800a-b5fe-4697-8376-cdf8a50b69d2-kube-api-access-bvhpl\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078300 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078058 2586 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078300 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078067 2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078300 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078101 2586 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078300 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078110 2586 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b99800a-b5fe-4697-8376-cdf8a50b69d2-config-out\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078300 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078118 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078300 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078126 2586 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-configmap-metrics-client-ca\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078300 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078135 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-db\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078300 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078143 2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078300 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078151 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078300 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078159 2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078300 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078167 2586 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-grpc-tls\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078300 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078175 2586 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-web-config\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078300 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078182 2586 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-config\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078300 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078190 2586 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b99800a-b5fe-4697-8376-cdf8a50b69d2-secret-metrics-client-certs\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.078300 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.078198 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b99800a-b5fe-4697-8376-cdf8a50b69d2-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:52:08.114125 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.114059 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" event={"ID":"d9b29353-5be0-4275-85c1-52686e36de42","Type":"ContainerStarted","Data":"24892c90a8a203fc96a3b77252992aa345db0aee7a2f122be05e09a7224610a6"} Jul 06 20:52:08.117111 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.117087 2586 generic.go:356] "Generic (PLEG): container finished" podID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerID="a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901" exitCode=0 Jul 06 20:52:08.117111 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.117113 2586 generic.go:356] "Generic (PLEG): container finished" podID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerID="a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321" exitCode=0 Jul 06 20:52:08.117218 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.117120 2586 generic.go:356] "Generic (PLEG): container finished" podID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerID="262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59" exitCode=0 Jul 06 20:52:08.117218 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.117129 2586 generic.go:356] "Generic (PLEG): container finished" podID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerID="6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef" exitCode=0 Jul 06 20:52:08.117218 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.117135 2586 generic.go:356] "Generic (PLEG): container finished" podID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerID="1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72" exitCode=0 Jul 06 20:52:08.117218 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.117140 2586 generic.go:356] "Generic (PLEG): container finished" podID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerID="1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2" exitCode=0 Jul 06 20:52:08.117218 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.117169 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.117218 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.117173 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b99800a-b5fe-4697-8376-cdf8a50b69d2","Type":"ContainerDied","Data":"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901"} Jul 06 20:52:08.117440 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.117253 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b99800a-b5fe-4697-8376-cdf8a50b69d2","Type":"ContainerDied","Data":"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321"} Jul 06 20:52:08.117440 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.117298 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b99800a-b5fe-4697-8376-cdf8a50b69d2","Type":"ContainerDied","Data":"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59"} Jul 06 20:52:08.117440 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.117318 2586 scope.go:117] "RemoveContainer" containerID="a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901" Jul 06 20:52:08.117440 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.117339 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b99800a-b5fe-4697-8376-cdf8a50b69d2","Type":"ContainerDied","Data":"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef"} Jul 06 20:52:08.117440 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.117381 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b99800a-b5fe-4697-8376-cdf8a50b69d2","Type":"ContainerDied","Data":"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72"} Jul 06 20:52:08.117440 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.117422 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b99800a-b5fe-4697-8376-cdf8a50b69d2","Type":"ContainerDied","Data":"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2"} Jul 06 20:52:08.117682 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.117463 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b99800a-b5fe-4697-8376-cdf8a50b69d2","Type":"ContainerDied","Data":"0a810dd9e756fa2cd207b398791f41f9d98395a65b1da5fcbaf7baac8614758c"} Jul 06 20:52:08.125922 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.125885 2586 scope.go:117] "RemoveContainer" containerID="a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321" Jul 06 20:52:08.132983 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.132962 2586 scope.go:117] "RemoveContainer" containerID="262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59" Jul 06 20:52:08.139987 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.139966 2586 scope.go:117] "RemoveContainer" containerID="6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef" Jul 06 20:52:08.143643 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.143613 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:52:08.147573 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.147554 2586 scope.go:117] "RemoveContainer" containerID="1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72" Jul 06 20:52:08.153415 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.153393 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:52:08.155248 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.155228 2586 scope.go:117] "RemoveContainer" containerID="1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2" Jul 06 20:52:08.162745 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.162727 2586 scope.go:117] "RemoveContainer" containerID="6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91" Jul 06 20:52:08.169615 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.169596 2586 scope.go:117] "RemoveContainer" containerID="a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901" Jul 06 20:52:08.169894 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:52:08.169875 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901\": container with ID starting with a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901 not found: ID does not exist" containerID="a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901" Jul 06 20:52:08.169981 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.169906 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901"} err="failed to get container status \"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901\": rpc error: code = NotFound desc = could not find container \"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901\": container with ID starting with a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901 not found: ID does not exist" Jul 06 20:52:08.169981 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.169930 2586 scope.go:117] "RemoveContainer" containerID="a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321" Jul 06 20:52:08.170212 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:52:08.170192 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321\": container with ID starting with a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321 not found: ID does not exist" containerID="a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321" Jul 06 20:52:08.170268 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.170228 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321"} err="failed to get container status \"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321\": rpc error: code = NotFound desc = could not find container \"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321\": container with ID starting with a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321 not found: ID does not exist" Jul 06 20:52:08.170268 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.170245 2586 scope.go:117] "RemoveContainer" containerID="262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59" Jul 06 20:52:08.170479 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:52:08.170461 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59\": container with ID starting with 262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59 not found: ID does not exist" containerID="262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59" Jul 06 20:52:08.170513 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.170484 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59"} err="failed to get container status \"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59\": rpc error: code = NotFound desc = could not find container \"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59\": container with ID starting with 262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59 not found: ID does not exist" Jul 06 20:52:08.170513 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.170498 2586 scope.go:117] "RemoveContainer" containerID="6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef" Jul 06 20:52:08.170698 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:52:08.170683 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef\": container with ID starting with 6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef not found: ID does not exist" containerID="6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef" Jul 06 20:52:08.170735 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.170701 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef"} err="failed to get container status \"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef\": rpc error: code = NotFound desc = could not find container \"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef\": container with ID starting with 6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef not found: ID does not exist" Jul 06 20:52:08.170735 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.170712 2586 scope.go:117] "RemoveContainer" containerID="1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72" Jul 06 20:52:08.170907 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:52:08.170894 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72\": container with ID starting with 1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72 not found: ID does not exist" containerID="1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72" Jul 06 20:52:08.170945 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.170910 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72"} err="failed to get container status \"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72\": rpc error: code = NotFound desc = could not find container \"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72\": container with ID starting with 1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72 not found: ID does not exist" Jul 06 20:52:08.170945 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.170924 2586 scope.go:117] "RemoveContainer" containerID="1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2" Jul 06 20:52:08.171136 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:52:08.171112 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2\": container with ID starting with 1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2 not found: ID does not exist" containerID="1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2" Jul 06 20:52:08.171198 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.171146 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2"} err="failed to get container status \"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2\": rpc error: code = NotFound desc = could not find container \"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2\": container with ID starting with 1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2 not found: ID does not exist" Jul 06 20:52:08.171198 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.171164 2586 scope.go:117] "RemoveContainer" containerID="6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91" Jul 06 20:52:08.171373 ip-10-0-142-58 kubenswrapper[2586]: E0706 20:52:08.171358 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91\": container with ID starting with 6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91 not found: ID does not exist" containerID="6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91" Jul 06 20:52:08.171439 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.171376 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91"} err="failed to get container status \"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91\": rpc error: code = NotFound desc = could not find container \"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91\": container with ID starting with 6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91 not found: ID does not exist" Jul 06 20:52:08.171439 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.171388 2586 scope.go:117] "RemoveContainer" containerID="a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901" Jul 06 20:52:08.171604 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.171587 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901"} err="failed to get container status \"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901\": rpc error: code = NotFound desc = could not find container \"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901\": container with ID starting with a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901 not found: ID does not exist" Jul 06 20:52:08.171641 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.171605 2586 scope.go:117] "RemoveContainer" containerID="a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321" Jul 06 20:52:08.171787 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.171772 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321"} err="failed to get container status \"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321\": rpc error: code = NotFound desc = could not find container \"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321\": container with ID starting with a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321 not found: ID does not exist" Jul 06 20:52:08.171838 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.171786 2586 scope.go:117] "RemoveContainer" containerID="262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59" Jul 06 20:52:08.171990 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.171971 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59"} err="failed to get container status \"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59\": rpc error: code = NotFound desc = could not find container \"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59\": container with ID starting with 262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59 not found: ID does not exist" Jul 06 20:52:08.172032 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.171991 2586 scope.go:117] "RemoveContainer" containerID="6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef" Jul 06 20:52:08.172238 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.172221 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef"} err="failed to get container status \"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef\": rpc error: code = NotFound desc = could not find container \"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef\": container with ID starting with 6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef not found: ID does not exist" Jul 06 20:52:08.172305 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.172239 2586 scope.go:117] "RemoveContainer" containerID="1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72" Jul 06 20:52:08.172441 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.172423 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72"} err="failed to get container status \"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72\": rpc error: code = NotFound desc = could not find container \"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72\": container with ID starting with 1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72 not found: ID does not exist" Jul 06 20:52:08.172551 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.172443 2586 scope.go:117] "RemoveContainer" containerID="1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2" Jul 06 20:52:08.172692 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.172676 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2"} err="failed to get container status \"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2\": rpc error: code = NotFound desc = could not find container \"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2\": container with ID starting with 1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2 not found: ID does not exist" Jul 06 20:52:08.172738 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.172694 2586 scope.go:117] "RemoveContainer" containerID="6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91" Jul 06 20:52:08.172900 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.172882 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91"} err="failed to get container status \"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91\": rpc error: code = NotFound desc = could not find container \"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91\": container with ID starting with 6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91 not found: ID does not exist" Jul 06 20:52:08.172943 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.172901 2586 scope.go:117] "RemoveContainer" containerID="a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901" Jul 06 20:52:08.173162 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.173142 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901"} err="failed to get container status \"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901\": rpc error: code = NotFound desc = could not find container \"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901\": container with ID starting with a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901 not found: ID does not exist" Jul 06 20:52:08.173162 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.173162 2586 scope.go:117] "RemoveContainer" containerID="a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321" Jul 06 20:52:08.173369 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.173347 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321"} err="failed to get container status \"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321\": rpc error: code = NotFound desc = could not find container \"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321\": container with ID starting with a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321 not found: ID does not exist" Jul 06 20:52:08.173422 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.173370 2586 scope.go:117] "RemoveContainer" containerID="262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59" Jul 06 20:52:08.173591 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.173575 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59"} err="failed to get container status \"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59\": rpc error: code = NotFound desc = could not find container \"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59\": container with ID starting with 262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59 not found: ID does not exist" Jul 06 20:52:08.173631 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.173590 2586 scope.go:117] "RemoveContainer" containerID="6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef" Jul 06 20:52:08.173836 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.173817 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef"} err="failed to get container status \"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef\": rpc error: code = NotFound desc = could not find container \"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef\": container with ID starting with 6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef not found: ID does not exist" Jul 06 20:52:08.173880 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.173836 2586 scope.go:117] "RemoveContainer" containerID="1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72" Jul 06 20:52:08.174047 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.174028 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72"} err="failed to get container status \"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72\": rpc error: code = NotFound desc = could not find container \"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72\": container with ID starting with 1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72 not found: ID does not exist" Jul 06 20:52:08.174126 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.174050 2586 scope.go:117] "RemoveContainer" containerID="1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2" Jul 06 20:52:08.174295 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.174278 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2"} err="failed to get container status \"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2\": rpc error: code = NotFound desc = could not find container \"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2\": container with ID starting with 1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2 not found: ID does not exist" Jul 06 20:52:08.174341 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.174295 2586 scope.go:117] "RemoveContainer" containerID="6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91" Jul 06 20:52:08.174497 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.174479 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91"} err="failed to get container status \"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91\": rpc error: code = NotFound desc = could not find container \"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91\": container with ID starting with 6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91 not found: ID does not exist" Jul 06 20:52:08.174564 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.174498 2586 scope.go:117] "RemoveContainer" containerID="a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901" Jul 06 20:52:08.174717 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.174702 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901"} err="failed to get container status \"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901\": rpc error: code = NotFound desc = could not find container \"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901\": container with ID starting with a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901 not found: ID does not exist" Jul 06 20:52:08.174762 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.174717 2586 scope.go:117] "RemoveContainer" containerID="a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321" Jul 06 20:52:08.174893 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.174879 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321"} err="failed to get container status \"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321\": rpc error: code = NotFound desc = could not find container \"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321\": container with ID starting with a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321 not found: ID does not exist" Jul 06 20:52:08.174893 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.174892 2586 scope.go:117] "RemoveContainer" containerID="262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59" Jul 06 20:52:08.175098 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.175062 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59"} err="failed to get container status \"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59\": rpc error: code = NotFound desc = could not find container \"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59\": container with ID starting with 262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59 not found: ID does not exist" Jul 06 20:52:08.175176 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.175101 2586 scope.go:117] "RemoveContainer" containerID="6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef" Jul 06 20:52:08.175349 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.175330 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef"} err="failed to get container status \"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef\": rpc error: code = NotFound desc = could not find container \"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef\": container with ID starting with 6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef not found: ID does not exist" Jul 06 20:52:08.175395 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.175350 2586 scope.go:117] "RemoveContainer" containerID="1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72" Jul 06 20:52:08.175557 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.175541 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72"} err="failed to get container status \"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72\": rpc error: code = NotFound desc = could not find container \"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72\": container with ID starting with 1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72 not found: ID does not exist" Jul 06 20:52:08.175603 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.175557 2586 scope.go:117] "RemoveContainer" containerID="1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2" Jul 06 20:52:08.175765 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.175749 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2"} err="failed to get container status \"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2\": rpc error: code = NotFound desc = could not find container \"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2\": container with ID starting with 1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2 not found: ID does not exist" Jul 06 20:52:08.175808 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.175766 2586 scope.go:117] "RemoveContainer" containerID="6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91" Jul 06 20:52:08.175966 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.175946 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91"} err="failed to get container status \"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91\": rpc error: code = NotFound desc = could not find container \"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91\": container with ID starting with 6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91 not found: ID does not exist" Jul 06 20:52:08.176026 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.175966 2586 scope.go:117] "RemoveContainer" containerID="a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901" Jul 06 20:52:08.176200 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.176182 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901"} err="failed to get container status \"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901\": rpc error: code = NotFound desc = could not find container \"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901\": container with ID starting with a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901 not found: ID does not exist" Jul 06 20:52:08.176253 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.176200 2586 scope.go:117] "RemoveContainer" containerID="a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321" Jul 06 20:52:08.176407 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.176389 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321"} err="failed to get container status \"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321\": rpc error: code = NotFound desc = could not find container \"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321\": container with ID starting with a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321 not found: ID does not exist" Jul 06 20:52:08.176478 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.176408 2586 scope.go:117] "RemoveContainer" containerID="262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59" Jul 06 20:52:08.176639 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.176621 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59"} err="failed to get container status \"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59\": rpc error: code = NotFound desc = could not find container \"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59\": container with ID starting with 262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59 not found: ID does not exist" Jul 06 20:52:08.176695 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.176639 2586 scope.go:117] "RemoveContainer" containerID="6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef" Jul 06 20:52:08.176839 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.176814 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef"} err="failed to get container status \"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef\": rpc error: code = NotFound desc = could not find container \"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef\": container with ID starting with 6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef not found: ID does not exist" Jul 06 20:52:08.176839 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.176833 2586 scope.go:117] "RemoveContainer" containerID="1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72" Jul 06 20:52:08.177062 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.177045 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72"} err="failed to get container status \"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72\": rpc error: code = NotFound desc = could not find container \"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72\": container with ID starting with 1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72 not found: ID does not exist" Jul 06 20:52:08.177151 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.177063 2586 scope.go:117] "RemoveContainer" containerID="1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2" Jul 06 20:52:08.177292 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.177274 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2"} err="failed to get container status \"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2\": rpc error: code = NotFound desc = could not find container \"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2\": container with ID starting with 1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2 not found: ID does not exist" Jul 06 20:52:08.177357 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.177294 2586 scope.go:117] "RemoveContainer" containerID="6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91" Jul 06 20:52:08.177515 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.177497 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91"} err="failed to get container status \"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91\": rpc error: code = NotFound desc = could not find container \"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91\": container with ID starting with 6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91 not found: ID does not exist" Jul 06 20:52:08.177559 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.177516 2586 scope.go:117] "RemoveContainer" containerID="a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901" Jul 06 20:52:08.177712 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.177695 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901"} err="failed to get container status \"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901\": rpc error: code = NotFound desc = could not find container \"a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901\": container with ID starting with a58e58f98c296c6ab0d0dc843a8f80153a00aef5445c1df1b1982d1f6cdd8901 not found: ID does not exist" Jul 06 20:52:08.177767 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.177712 2586 scope.go:117] "RemoveContainer" containerID="a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321" Jul 06 20:52:08.177915 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.177901 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321"} err="failed to get container status \"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321\": rpc error: code = NotFound desc = could not find container \"a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321\": container with ID starting with a2889f8e91bebb0ce13eb6888f7003de4612989f01349e0c2a1f6b0d5f905321 not found: ID does not exist" Jul 06 20:52:08.177960 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.177914 2586 scope.go:117] "RemoveContainer" containerID="262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59" Jul 06 20:52:08.178069 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.178054 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59"} err="failed to get container status \"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59\": rpc error: code = NotFound desc = could not find container \"262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59\": container with ID starting with 262e22043d36ecabe4f370dca4d55872a8914778187ee98da001579231babc59 not found: ID does not exist" Jul 06 20:52:08.178121 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.178070 2586 scope.go:117] "RemoveContainer" containerID="6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef" Jul 06 20:52:08.178294 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.178277 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef"} err="failed to get container status \"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef\": rpc error: code = NotFound desc = could not find container \"6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef\": container with ID starting with 6810c4b2537c6d52585165684ec764da66379dc0a87a88e98f203aefc9b3f4ef not found: ID does not exist" Jul 06 20:52:08.178355 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.178295 2586 scope.go:117] "RemoveContainer" containerID="1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72" Jul 06 20:52:08.178513 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.178493 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72"} err="failed to get container status \"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72\": rpc error: code = NotFound desc = could not find container \"1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72\": container with ID starting with 1190015a0c44c6a2d02dbaa0463385c74cce002895f8f08a73ffb7324c560b72 not found: ID does not exist" Jul 06 20:52:08.178557 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.178514 2586 scope.go:117] "RemoveContainer" containerID="1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2" Jul 06 20:52:08.178766 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.178739 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2"} err="failed to get container status \"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2\": rpc error: code = NotFound desc = could not find container \"1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2\": container with ID starting with 1bc81d6744e990e076662e39aff297b8dfbcdf300c57ae2097310a1f80c2fef2 not found: ID does not exist" Jul 06 20:52:08.178865 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.178767 2586 scope.go:117] "RemoveContainer" containerID="6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91" Jul 06 20:52:08.179028 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.179008 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91"} err="failed to get container status \"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91\": rpc error: code = NotFound desc = could not find container \"6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91\": container with ID starting with 6e3bc1953b3532a2c00f74a524c8dc89018aec1867a5756fdcef8cf84179df91 not found: ID does not exist" Jul 06 20:52:08.190206 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190175 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:52:08.190483 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190470 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="thanos-sidecar" Jul 06 20:52:08.190526 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190485 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="thanos-sidecar" Jul 06 20:52:08.190526 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190497 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="kube-rbac-proxy-web" Jul 06 20:52:08.190526 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190504 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="kube-rbac-proxy-web" Jul 06 20:52:08.190526 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190509 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="kube-rbac-proxy" Jul 06 20:52:08.190526 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190516 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="kube-rbac-proxy" Jul 06 20:52:08.190663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190531 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="prometheus" Jul 06 20:52:08.190663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190537 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="prometheus" Jul 06 20:52:08.190663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190547 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="config-reloader" Jul 06 20:52:08.190663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190552 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="config-reloader" Jul 06 20:52:08.190663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190560 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="init-config-reloader" Jul 06 20:52:08.190663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190565 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="init-config-reloader" Jul 06 20:52:08.190663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190572 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="kube-rbac-proxy-thanos" Jul 06 20:52:08.190663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190577 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="kube-rbac-proxy-thanos" Jul 06 20:52:08.190663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190622 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="prometheus" Jul 06 20:52:08.190663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190629 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="kube-rbac-proxy-thanos" Jul 06 20:52:08.190663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190634 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="kube-rbac-proxy-web" Jul 06 20:52:08.190663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190640 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="config-reloader" Jul 06 20:52:08.190663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190646 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="thanos-sidecar" Jul 06 20:52:08.190663 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.190653 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" containerName="kube-rbac-proxy" Jul 06 20:52:08.195801 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.195783 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.199006 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.198983 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 20:52:08.199303 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.199237 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 20:52:08.199303 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.199242 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 20:52:08.199303 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.199273 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 20:52:08.199487 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.199308 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 20:52:08.199487 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.199346 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 20:52:08.199635 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.199618 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1m5kkm0mrvgqv\"" Jul 06 20:52:08.199770 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.199753 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 20:52:08.199845 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.199830 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 20:52:08.199883 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.199853 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 20:52:08.199883 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.199873 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6dpb2\"" Jul 06 20:52:08.200326 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.200211 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 20:52:08.200326 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.200212 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 20:52:08.200326 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.200238 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 20:52:08.200326 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.200246 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 20:52:08.203053 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.203032 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 20:52:08.205483 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.205464 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 20:52:08.214964 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.214939 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:52:08.280200 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280162 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-config\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280200 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280204 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280396 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280223 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nnf8\" (UniqueName: \"kubernetes.io/projected/4bbf1894-5eb8-490b-9f74-f9221ae80e34-kube-api-access-9nnf8\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280396 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280244 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4bbf1894-5eb8-490b-9f74-f9221ae80e34-config-out\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280396 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280273 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280396 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280293 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280396 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280323 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280396 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280338 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280396 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280377 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4bbf1894-5eb8-490b-9f74-f9221ae80e34-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280621 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280405 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280621 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280448 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280621 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280465 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-web-config\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280621 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280495 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280621 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280510 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280621 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280534 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4bbf1894-5eb8-490b-9f74-f9221ae80e34-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280621 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280563 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280621 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280587 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280621 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280607 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280867 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280626 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.280867 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.280686 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382235 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382192 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4bbf1894-5eb8-490b-9f74-f9221ae80e34-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382416 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382245 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382416 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382265 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382416 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382293 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382416 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382312 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382416 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382341 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382416 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382374 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-config\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382684 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382523 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382684 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382569 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nnf8\" (UniqueName: \"kubernetes.io/projected/4bbf1894-5eb8-490b-9f74-f9221ae80e34-kube-api-access-9nnf8\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382684 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382605 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4bbf1894-5eb8-490b-9f74-f9221ae80e34-config-out\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382684 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382633 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382684 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382649 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4bbf1894-5eb8-490b-9f74-f9221ae80e34-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382684 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382656 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382996 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382719 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382996 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382742 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382996 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382769 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4bbf1894-5eb8-490b-9f74-f9221ae80e34-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382996 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382794 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382996 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382835 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382996 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382864 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-web-config\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382996 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382901 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.382996 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.382922 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.383406 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.383220 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.383406 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.383266 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.383504 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.383456 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.386360 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.383811 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.386360 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.384233 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.386360 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.385461 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-config\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.386360 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.385603 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.386360 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.385639 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.386360 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.385655 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.386360 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.386207 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.386360 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.386287 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4bbf1894-5eb8-490b-9f74-f9221ae80e34-config-out\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.386874 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.386618 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.386874 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.386852 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4bbf1894-5eb8-490b-9f74-f9221ae80e34-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.387256 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.387235 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4bbf1894-5eb8-490b-9f74-f9221ae80e34-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.387982 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.387961 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-web-config\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.388051 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.388010 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.388051 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.388035 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.388361 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.388342 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4bbf1894-5eb8-490b-9f74-f9221ae80e34-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.392338 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.392320 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nnf8\" (UniqueName: \"kubernetes.io/projected/4bbf1894-5eb8-490b-9f74-f9221ae80e34-kube-api-access-9nnf8\") pod \"prometheus-k8s-0\" (UID: \"4bbf1894-5eb8-490b-9f74-f9221ae80e34\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.506625 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.506581 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:52:08.676200 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:08.676152 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:52:08.681133 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:52:08.681101 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bbf1894_5eb8_490b_9f74_f9221ae80e34.slice/crio-70e469ea7c79f23dc6db317c328d86315cb3568af5ce61d616c08604690b70ed WatchSource:0}: Error finding container 70e469ea7c79f23dc6db317c328d86315cb3568af5ce61d616c08604690b70ed: Status 404 returned error can't find the container with id 70e469ea7c79f23dc6db317c328d86315cb3568af5ce61d616c08604690b70ed Jul 06 20:52:09.123061 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:09.122962 2586 generic.go:356] "Generic (PLEG): container finished" podID="4bbf1894-5eb8-490b-9f74-f9221ae80e34" containerID="0f1b90478e234af9d6a2d2a3ec46c898627f9d6295b18c39329437a88952a272" exitCode=0 Jul 06 20:52:09.123519 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:09.123059 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bbf1894-5eb8-490b-9f74-f9221ae80e34","Type":"ContainerDied","Data":"0f1b90478e234af9d6a2d2a3ec46c898627f9d6295b18c39329437a88952a272"} Jul 06 20:52:09.123519 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:09.123143 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bbf1894-5eb8-490b-9f74-f9221ae80e34","Type":"ContainerStarted","Data":"70e469ea7c79f23dc6db317c328d86315cb3568af5ce61d616c08604690b70ed"} Jul 06 20:52:09.214798 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:09.214760 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b99800a-b5fe-4697-8376-cdf8a50b69d2" path="/var/lib/kubelet/pods/4b99800a-b5fe-4697-8376-cdf8a50b69d2/volumes" Jul 06 20:52:10.130891 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:10.130856 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bbf1894-5eb8-490b-9f74-f9221ae80e34","Type":"ContainerStarted","Data":"7821d7c0cb49f1e4ff309cfa4885e535caf7aad5f0fc302cf3ef1124ae5276b7"} Jul 06 20:52:10.131315 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:10.130970 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bbf1894-5eb8-490b-9f74-f9221ae80e34","Type":"ContainerStarted","Data":"9c248d88e54cfb960c4b6618706b61b1aa5ff2dec83a5daed7f8869f2706883d"} Jul 06 20:52:10.131315 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:10.131015 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bbf1894-5eb8-490b-9f74-f9221ae80e34","Type":"ContainerStarted","Data":"add4ef4d5c8b20b15e62d36dca96ae6807675e47856198c9a130d9db82dea039"} Jul 06 20:52:10.131315 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:10.131057 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bbf1894-5eb8-490b-9f74-f9221ae80e34","Type":"ContainerStarted","Data":"419f71b7ed40939eef2a5e96b7f684e50617852c2b5c582f61189400b268634e"} Jul 06 20:52:10.131315 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:10.131111 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bbf1894-5eb8-490b-9f74-f9221ae80e34","Type":"ContainerStarted","Data":"979eaed284cd2380350ff4563c934db3a224f7ec64b3311ecd94580b5409c2cc"} Jul 06 20:52:10.131315 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:10.131155 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4bbf1894-5eb8-490b-9f74-f9221ae80e34","Type":"ContainerStarted","Data":"c8d20595f293c491c0e7ee5b548234b3ed49d13024f02e2c179d43ab5cce6441"} Jul 06 20:52:10.166880 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:10.166811 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.145407352 podStartE2EDuration="2.16679005s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.382698ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:52:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:52:10.164907503 +0000 UTC m=+211.498724016" watchObservedRunningTime="2026-07-06 20:52:10.16679005 +0000 UTC m=+211.500606563" Jul 06 20:52:11.137324 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:11.137284 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" event={"ID":"d9b29353-5be0-4275-85c1-52686e36de42","Type":"ContainerStarted","Data":"08ceba27e18ddf490cd4ef61f020e7100d70d2253fb78a8e08869df2acdd308f"} Jul 06 20:52:11.137700 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:11.137347 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" event={"ID":"d9b29353-5be0-4275-85c1-52686e36de42","Type":"ContainerStarted","Data":"23a6e961e15bd1fbf8aeed7e056d3c3e34176ec5aa627fbf84150c8263be99b5"} Jul 06 20:52:11.137700 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:11.137370 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" event={"ID":"d9b29353-5be0-4275-85c1-52686e36de42","Type":"ContainerStarted","Data":"dbb3c2d1d403aaba0049db7bc66e68388af987ea00b12111ed0064135ef801d2"} Jul 06 20:52:11.164584 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:11.164500 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7bfd5876d4-2v8bj" podStartSLOduration=1.900496259 podStartE2EDuration="4.164479105s" totalImagesPullingTime="2.263982846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:52:11.16339865 +0000 UTC m=+212.497215168" watchObservedRunningTime="2026-07-06 20:52:11.164479105 +0000 UTC m=+212.498295619" Jul 06 20:52:13.507071 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:52:13.507020 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:53:08.507815 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:53:08.507703 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:53:08.523864 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:53:08.523837 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:53:09.378846 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:53:09.378817 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:53:39.111447 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:53:39.111420 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fxmcj_5ec4b5d3-3779-4781-809d-da31fe3a5c6c/console-operator/2.log" Jul 06 20:53:39.121231 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:53:39.121198 2586 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 20:53:39.122525 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:53:39.122500 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fxmcj_5ec4b5d3-3779-4781-809d-da31fe3a5c6c/console-operator/2.log" Jul 06 20:57:52.062069 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:52.062036 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-jkbpl"] Jul 06 20:57:52.065359 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:52.065338 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-jkbpl" Jul 06 20:57:52.068102 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:52.068060 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 06 20:57:52.069106 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:52.069071 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-vglgw\"" Jul 06 20:57:52.069106 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:52.069098 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 06 20:57:52.069282 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:52.069087 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 06 20:57:52.077478 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:52.077449 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-jkbpl"] Jul 06 20:57:52.229747 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:52.229700 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fc3f4c0-0b73-4494-87e0-cf32d0179983-cert\") pod \"odh-model-controller-84b54b7f97-jkbpl\" (UID: \"7fc3f4c0-0b73-4494-87e0-cf32d0179983\") " pod="kserve/odh-model-controller-84b54b7f97-jkbpl" Jul 06 20:57:52.229914 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:52.229759 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44z9f\" (UniqueName: \"kubernetes.io/projected/7fc3f4c0-0b73-4494-87e0-cf32d0179983-kube-api-access-44z9f\") pod \"odh-model-controller-84b54b7f97-jkbpl\" (UID: \"7fc3f4c0-0b73-4494-87e0-cf32d0179983\") " pod="kserve/odh-model-controller-84b54b7f97-jkbpl" Jul 06 20:57:52.331320 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:52.331222 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fc3f4c0-0b73-4494-87e0-cf32d0179983-cert\") pod \"odh-model-controller-84b54b7f97-jkbpl\" (UID: \"7fc3f4c0-0b73-4494-87e0-cf32d0179983\") " pod="kserve/odh-model-controller-84b54b7f97-jkbpl" Jul 06 20:57:52.331320 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:52.331282 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44z9f\" (UniqueName: \"kubernetes.io/projected/7fc3f4c0-0b73-4494-87e0-cf32d0179983-kube-api-access-44z9f\") pod \"odh-model-controller-84b54b7f97-jkbpl\" (UID: \"7fc3f4c0-0b73-4494-87e0-cf32d0179983\") " pod="kserve/odh-model-controller-84b54b7f97-jkbpl" Jul 06 20:57:52.333728 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:52.333688 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fc3f4c0-0b73-4494-87e0-cf32d0179983-cert\") pod \"odh-model-controller-84b54b7f97-jkbpl\" (UID: \"7fc3f4c0-0b73-4494-87e0-cf32d0179983\") " pod="kserve/odh-model-controller-84b54b7f97-jkbpl" Jul 06 20:57:52.343027 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:52.342990 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44z9f\" (UniqueName: \"kubernetes.io/projected/7fc3f4c0-0b73-4494-87e0-cf32d0179983-kube-api-access-44z9f\") pod \"odh-model-controller-84b54b7f97-jkbpl\" (UID: \"7fc3f4c0-0b73-4494-87e0-cf32d0179983\") " pod="kserve/odh-model-controller-84b54b7f97-jkbpl" Jul 06 20:57:52.375737 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:52.375699 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-jkbpl" Jul 06 20:57:52.512044 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:52.512018 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-jkbpl"] Jul 06 20:57:52.514749 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:57:52.514723 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fc3f4c0_0b73_4494_87e0_cf32d0179983.slice/crio-69fc9e013d33d6ae556f1a43d996ed80cad73160292cea697798f3917d973b59 WatchSource:0}: Error finding container 69fc9e013d33d6ae556f1a43d996ed80cad73160292cea697798f3917d973b59: Status 404 returned error can't find the container with id 69fc9e013d33d6ae556f1a43d996ed80cad73160292cea697798f3917d973b59 Jul 06 20:57:52.516028 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:52.516012 2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:57:53.474097 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:53.474047 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-jkbpl" event={"ID":"7fc3f4c0-0b73-4494-87e0-cf32d0179983","Type":"ContainerStarted","Data":"69fc9e013d33d6ae556f1a43d996ed80cad73160292cea697798f3917d973b59"} Jul 06 20:57:55.484863 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:55.484784 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-jkbpl" event={"ID":"7fc3f4c0-0b73-4494-87e0-cf32d0179983","Type":"ContainerStarted","Data":"d5cfb41954044c9ed6afac7ec0167066f8f704f3f13e13ac4447e47cdffdb369"} Jul 06 20:57:55.485242 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:55.484917 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-jkbpl" Jul 06 20:57:55.507621 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:57:55.507561 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-jkbpl" podStartSLOduration=0.838335137 podStartE2EDuration="3.507542045s" totalImagesPullingTime="2.669206908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:57:55.50617408 +0000 UTC m=+556.839990607" watchObservedRunningTime="2026-07-06 20:57:55.507542045 +0000 UTC m=+556.841358557" Jul 06 20:58:06.490829 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:06.490800 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-jkbpl" Jul 06 20:58:07.354127 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:07.354087 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-tffdz"] Jul 06 20:58:07.357565 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:07.357544 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-tffdz" Jul 06 20:58:07.360142 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:07.360117 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 06 20:58:07.360266 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:07.360212 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-vpp4w\"" Jul 06 20:58:07.366197 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:07.366172 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-tffdz"] Jul 06 20:58:07.465739 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:07.465694 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c094cb-d3be-4c2a-b095-c485a49ad1dd-model-cache\") pod \"s3-init-tffdz\" (UID: \"b8c094cb-d3be-4c2a-b095-c485a49ad1dd\") " pod="kserve/s3-init-tffdz" Jul 06 20:58:07.465933 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:07.465761 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vj29\" (UniqueName: \"kubernetes.io/projected/b8c094cb-d3be-4c2a-b095-c485a49ad1dd-kube-api-access-7vj29\") pod \"s3-init-tffdz\" (UID: \"b8c094cb-d3be-4c2a-b095-c485a49ad1dd\") " pod="kserve/s3-init-tffdz" Jul 06 20:58:07.567040 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:07.567001 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c094cb-d3be-4c2a-b095-c485a49ad1dd-model-cache\") pod \"s3-init-tffdz\" (UID: \"b8c094cb-d3be-4c2a-b095-c485a49ad1dd\") " pod="kserve/s3-init-tffdz" Jul 06 20:58:07.567444 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:07.567070 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vj29\" (UniqueName: \"kubernetes.io/projected/b8c094cb-d3be-4c2a-b095-c485a49ad1dd-kube-api-access-7vj29\") pod \"s3-init-tffdz\" (UID: \"b8c094cb-d3be-4c2a-b095-c485a49ad1dd\") " pod="kserve/s3-init-tffdz" Jul 06 20:58:07.567507 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:07.567480 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c094cb-d3be-4c2a-b095-c485a49ad1dd-model-cache\") pod \"s3-init-tffdz\" (UID: \"b8c094cb-d3be-4c2a-b095-c485a49ad1dd\") " pod="kserve/s3-init-tffdz" Jul 06 20:58:07.577063 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:07.577028 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vj29\" (UniqueName: \"kubernetes.io/projected/b8c094cb-d3be-4c2a-b095-c485a49ad1dd-kube-api-access-7vj29\") pod \"s3-init-tffdz\" (UID: \"b8c094cb-d3be-4c2a-b095-c485a49ad1dd\") " pod="kserve/s3-init-tffdz" Jul 06 20:58:07.679015 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:07.678985 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-tffdz" Jul 06 20:58:07.816965 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:07.816938 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-tffdz"] Jul 06 20:58:07.819571 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:58:07.819543 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8c094cb_d3be_4c2a_b095_c485a49ad1dd.slice/crio-a572d1342f35be6fc4582bb31982ebfea048ec3577bba6f61a9057eb09d22ba4 WatchSource:0}: Error finding container a572d1342f35be6fc4582bb31982ebfea048ec3577bba6f61a9057eb09d22ba4: Status 404 returned error can't find the container with id a572d1342f35be6fc4582bb31982ebfea048ec3577bba6f61a9057eb09d22ba4 Jul 06 20:58:08.539044 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:08.538983 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-tffdz" event={"ID":"b8c094cb-d3be-4c2a-b095-c485a49ad1dd","Type":"ContainerStarted","Data":"a572d1342f35be6fc4582bb31982ebfea048ec3577bba6f61a9057eb09d22ba4"} Jul 06 20:58:12.561270 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:12.561226 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-tffdz" event={"ID":"b8c094cb-d3be-4c2a-b095-c485a49ad1dd","Type":"ContainerStarted","Data":"2907b96848497bd8830aed4c2c0b4694841aa302a4d6f2eba0b58a91503a0f27"} Jul 06 20:58:13.566748 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:13.566717 2586 generic.go:356] "Generic (PLEG): container finished" podID="b8c094cb-d3be-4c2a-b095-c485a49ad1dd" containerID="2907b96848497bd8830aed4c2c0b4694841aa302a4d6f2eba0b58a91503a0f27" exitCode=0 Jul 06 20:58:13.567236 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:13.566812 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-tffdz" event={"ID":"b8c094cb-d3be-4c2a-b095-c485a49ad1dd","Type":"ContainerDied","Data":"2907b96848497bd8830aed4c2c0b4694841aa302a4d6f2eba0b58a91503a0f27"} Jul 06 20:58:18.594853 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:18.594758 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-tffdz" event={"ID":"b8c094cb-d3be-4c2a-b095-c485a49ad1dd","Type":"ContainerStarted","Data":"d8bb48d90f82c28735173b43a0d96c2af3d5dd0453c843c94c2cc17b44196ee8"} Jul 06 20:58:18.614554 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:18.614503 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-tffdz" podStartSLOduration=1.626932956 podStartE2EDuration="11.614487703s" totalImagesPullingTime="8.519841988s" totalInitContainerRuntime="1.467712759s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:58:18.613550054 +0000 UTC m=+579.947366582" watchObservedRunningTime="2026-07-06 20:58:18.614487703 +0000 UTC m=+579.948304215" Jul 06 20:58:39.147538 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:39.147509 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fxmcj_5ec4b5d3-3779-4781-809d-da31fe3a5c6c/console-operator/2.log" Jul 06 20:58:39.150043 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:58:39.150019 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fxmcj_5ec4b5d3-3779-4781-809d-da31fe3a5c6c/console-operator/2.log" Jul 06 20:59:23.863246 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:23.863155 2586 generic.go:356] "Generic (PLEG): container finished" podID="b8c094cb-d3be-4c2a-b095-c485a49ad1dd" containerID="d8bb48d90f82c28735173b43a0d96c2af3d5dd0453c843c94c2cc17b44196ee8" exitCode=0 Jul 06 20:59:23.863246 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:23.863224 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-tffdz" event={"ID":"b8c094cb-d3be-4c2a-b095-c485a49ad1dd","Type":"ContainerDied","Data":"d8bb48d90f82c28735173b43a0d96c2af3d5dd0453c843c94c2cc17b44196ee8"} Jul 06 20:59:24.989819 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:24.989789 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-tffdz" Jul 06 20:59:25.145820 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:25.145730 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c094cb-d3be-4c2a-b095-c485a49ad1dd-model-cache\") pod \"b8c094cb-d3be-4c2a-b095-c485a49ad1dd\" (UID: \"b8c094cb-d3be-4c2a-b095-c485a49ad1dd\") " Jul 06 20:59:25.145820 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:25.145779 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vj29\" (UniqueName: \"kubernetes.io/projected/b8c094cb-d3be-4c2a-b095-c485a49ad1dd-kube-api-access-7vj29\") pod \"b8c094cb-d3be-4c2a-b095-c485a49ad1dd\" (UID: \"b8c094cb-d3be-4c2a-b095-c485a49ad1dd\") " Jul 06 20:59:25.148034 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:25.147998 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8c094cb-d3be-4c2a-b095-c485a49ad1dd-kube-api-access-7vj29" (OuterVolumeSpecName: "kube-api-access-7vj29") pod "b8c094cb-d3be-4c2a-b095-c485a49ad1dd" (UID: "b8c094cb-d3be-4c2a-b095-c485a49ad1dd"). InnerVolumeSpecName "kube-api-access-7vj29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:59:25.164690 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:25.164652 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c094cb-d3be-4c2a-b095-c485a49ad1dd-model-cache" (OuterVolumeSpecName: "model-cache") pod "b8c094cb-d3be-4c2a-b095-c485a49ad1dd" (UID: "b8c094cb-d3be-4c2a-b095-c485a49ad1dd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:59:25.246954 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:25.246923 2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c094cb-d3be-4c2a-b095-c485a49ad1dd-model-cache\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:59:25.246954 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:25.246953 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vj29\" (UniqueName: \"kubernetes.io/projected/b8c094cb-d3be-4c2a-b095-c485a49ad1dd-kube-api-access-7vj29\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 20:59:25.873154 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:25.873126 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-tffdz" Jul 06 20:59:25.873330 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:25.873148 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-tffdz" event={"ID":"b8c094cb-d3be-4c2a-b095-c485a49ad1dd","Type":"ContainerDied","Data":"a572d1342f35be6fc4582bb31982ebfea048ec3577bba6f61a9057eb09d22ba4"} Jul 06 20:59:25.873330 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:25.873187 2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a572d1342f35be6fc4582bb31982ebfea048ec3577bba6f61a9057eb09d22ba4" Jul 06 20:59:26.688712 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:26.688677 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg"] Jul 06 20:59:26.689114 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:26.689002 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8c094cb-d3be-4c2a-b095-c485a49ad1dd" containerName="s3-init" Jul 06 20:59:26.689114 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:26.689013 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8c094cb-d3be-4c2a-b095-c485a49ad1dd" containerName="s3-init" Jul 06 20:59:26.689114 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:26.689028 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8c094cb-d3be-4c2a-b095-c485a49ad1dd" containerName="download-hf-model" Jul 06 20:59:26.689114 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:26.689034 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8c094cb-d3be-4c2a-b095-c485a49ad1dd" containerName="download-hf-model" Jul 06 20:59:26.689114 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:26.689114 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8c094cb-d3be-4c2a-b095-c485a49ad1dd" containerName="s3-init" Jul 06 20:59:26.692261 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:26.692244 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg" Jul 06 20:59:26.694815 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:26.694799 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 06 20:59:26.694902 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:26.694798 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-vpp4w\"" Jul 06 20:59:26.702566 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:26.702541 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg"] Jul 06 20:59:26.760181 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:26.760144 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c75ad342-88e9-4f48-99b6-3bb5cc0d173a-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-s4kgg\" (UID: \"c75ad342-88e9-4f48-99b6-3bb5cc0d173a\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg" Jul 06 20:59:26.760181 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:26.760188 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rg5s\" (UniqueName: \"kubernetes.io/projected/c75ad342-88e9-4f48-99b6-3bb5cc0d173a-kube-api-access-7rg5s\") pod \"seaweedfs-tls-custom-6644bf5d6c-s4kgg\" (UID: \"c75ad342-88e9-4f48-99b6-3bb5cc0d173a\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg" Jul 06 20:59:26.860873 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:26.860823 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c75ad342-88e9-4f48-99b6-3bb5cc0d173a-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-s4kgg\" (UID: \"c75ad342-88e9-4f48-99b6-3bb5cc0d173a\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg" Jul 06 20:59:26.860873 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:26.860883 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rg5s\" (UniqueName: \"kubernetes.io/projected/c75ad342-88e9-4f48-99b6-3bb5cc0d173a-kube-api-access-7rg5s\") pod \"seaweedfs-tls-custom-6644bf5d6c-s4kgg\" (UID: \"c75ad342-88e9-4f48-99b6-3bb5cc0d173a\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg" Jul 06 20:59:26.861257 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:26.861237 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c75ad342-88e9-4f48-99b6-3bb5cc0d173a-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-s4kgg\" (UID: \"c75ad342-88e9-4f48-99b6-3bb5cc0d173a\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg" Jul 06 20:59:26.870371 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:26.870349 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rg5s\" (UniqueName: \"kubernetes.io/projected/c75ad342-88e9-4f48-99b6-3bb5cc0d173a-kube-api-access-7rg5s\") pod \"seaweedfs-tls-custom-6644bf5d6c-s4kgg\" (UID: \"c75ad342-88e9-4f48-99b6-3bb5cc0d173a\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg" Jul 06 20:59:27.002030 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:27.001925 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg" Jul 06 20:59:27.141110 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:27.141058 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg"] Jul 06 20:59:27.145104 ip-10-0-142-58 kubenswrapper[2586]: W0706 20:59:27.145061 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75ad342_88e9_4f48_99b6_3bb5cc0d173a.slice/crio-7724a7fa135849cca8dded9fa22b9c0983745037ca941076b1dab3e02b43db30 WatchSource:0}: Error finding container 7724a7fa135849cca8dded9fa22b9c0983745037ca941076b1dab3e02b43db30: Status 404 returned error can't find the container with id 7724a7fa135849cca8dded9fa22b9c0983745037ca941076b1dab3e02b43db30 Jul 06 20:59:27.884369 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:27.884336 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg" event={"ID":"c75ad342-88e9-4f48-99b6-3bb5cc0d173a","Type":"ContainerStarted","Data":"7724a7fa135849cca8dded9fa22b9c0983745037ca941076b1dab3e02b43db30"} Jul 06 20:59:30.899050 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:30.899002 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg" event={"ID":"c75ad342-88e9-4f48-99b6-3bb5cc0d173a","Type":"ContainerStarted","Data":"0023a42fc27059dfbe7461e55b0885a75b37dde99682d60a936853c2ffbd47ba"} Jul 06 20:59:30.917179 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:30.917127 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg" podStartSLOduration=2.027196553 podStartE2EDuration="4.917109633s" totalImagesPullingTime="2.88991308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:59:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:30.916517226 +0000 UTC m=+652.250333739" watchObservedRunningTime="2026-07-06 20:59:30.917109633 +0000 UTC m=+652.250926153" Jul 06 20:59:31.807221 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:31.807183 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg"] Jul 06 20:59:32.907821 ip-10-0-142-58 kubenswrapper[2586]: I0706 20:59:32.907780 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg" podUID="c75ad342-88e9-4f48-99b6-3bb5cc0d173a" containerName="seaweedfs-tls-custom" containerID="cri-o://0023a42fc27059dfbe7461e55b0885a75b37dde99682d60a936853c2ffbd47ba" gracePeriod=30 Jul 06 21:00:00.752449 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:00.752416 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg" Jul 06 21:00:00.868965 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:00.868825 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c75ad342-88e9-4f48-99b6-3bb5cc0d173a-data\") pod \"c75ad342-88e9-4f48-99b6-3bb5cc0d173a\" (UID: \"c75ad342-88e9-4f48-99b6-3bb5cc0d173a\") " Jul 06 21:00:00.869171 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:00.868986 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rg5s\" (UniqueName: \"kubernetes.io/projected/c75ad342-88e9-4f48-99b6-3bb5cc0d173a-kube-api-access-7rg5s\") pod \"c75ad342-88e9-4f48-99b6-3bb5cc0d173a\" (UID: \"c75ad342-88e9-4f48-99b6-3bb5cc0d173a\") " Jul 06 21:00:00.870202 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:00.870173 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75ad342-88e9-4f48-99b6-3bb5cc0d173a-data" (OuterVolumeSpecName: "data") pod "c75ad342-88e9-4f48-99b6-3bb5cc0d173a" (UID: "c75ad342-88e9-4f48-99b6-3bb5cc0d173a"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:00:00.871132 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:00.871106 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c75ad342-88e9-4f48-99b6-3bb5cc0d173a-kube-api-access-7rg5s" (OuterVolumeSpecName: "kube-api-access-7rg5s") pod "c75ad342-88e9-4f48-99b6-3bb5cc0d173a" (UID: "c75ad342-88e9-4f48-99b6-3bb5cc0d173a"). InnerVolumeSpecName "kube-api-access-7rg5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:00:00.970668 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:00.970628 2586 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c75ad342-88e9-4f48-99b6-3bb5cc0d173a-data\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 21:00:00.970668 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:00.970659 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rg5s\" (UniqueName: \"kubernetes.io/projected/c75ad342-88e9-4f48-99b6-3bb5cc0d173a-kube-api-access-7rg5s\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 21:00:01.023099 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:01.023029 2586 generic.go:356] "Generic (PLEG): container finished" podID="c75ad342-88e9-4f48-99b6-3bb5cc0d173a" containerID="0023a42fc27059dfbe7461e55b0885a75b37dde99682d60a936853c2ffbd47ba" exitCode=0 Jul 06 21:00:01.023099 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:01.023092 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg" Jul 06 21:00:01.023301 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:01.023116 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg" event={"ID":"c75ad342-88e9-4f48-99b6-3bb5cc0d173a","Type":"ContainerDied","Data":"0023a42fc27059dfbe7461e55b0885a75b37dde99682d60a936853c2ffbd47ba"} Jul 06 21:00:01.023301 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:01.023197 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg" event={"ID":"c75ad342-88e9-4f48-99b6-3bb5cc0d173a","Type":"ContainerDied","Data":"7724a7fa135849cca8dded9fa22b9c0983745037ca941076b1dab3e02b43db30"} Jul 06 21:00:01.023301 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:01.023219 2586 scope.go:117] "RemoveContainer" containerID="0023a42fc27059dfbe7461e55b0885a75b37dde99682d60a936853c2ffbd47ba" Jul 06 21:00:01.033381 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:01.033357 2586 scope.go:117] "RemoveContainer" containerID="0023a42fc27059dfbe7461e55b0885a75b37dde99682d60a936853c2ffbd47ba" Jul 06 21:00:01.033705 ip-10-0-142-58 kubenswrapper[2586]: E0706 21:00:01.033684 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0023a42fc27059dfbe7461e55b0885a75b37dde99682d60a936853c2ffbd47ba\": container with ID starting with 0023a42fc27059dfbe7461e55b0885a75b37dde99682d60a936853c2ffbd47ba not found: ID does not exist" containerID="0023a42fc27059dfbe7461e55b0885a75b37dde99682d60a936853c2ffbd47ba" Jul 06 21:00:01.033781 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:01.033714 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0023a42fc27059dfbe7461e55b0885a75b37dde99682d60a936853c2ffbd47ba"} err="failed to get container status \"0023a42fc27059dfbe7461e55b0885a75b37dde99682d60a936853c2ffbd47ba\": rpc error: code = NotFound desc = could not find container \"0023a42fc27059dfbe7461e55b0885a75b37dde99682d60a936853c2ffbd47ba\": container with ID starting with 0023a42fc27059dfbe7461e55b0885a75b37dde99682d60a936853c2ffbd47ba not found: ID does not exist" Jul 06 21:00:01.046055 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:01.046026 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg"] Jul 06 21:00:01.047380 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:01.047359 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-s4kgg"] Jul 06 21:00:01.213016 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:01.212984 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c75ad342-88e9-4f48-99b6-3bb5cc0d173a" path="/var/lib/kubelet/pods/c75ad342-88e9-4f48-99b6-3bb5cc0d173a/volumes" Jul 06 21:00:03.261554 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:03.261515 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-custom-bcq9n"] Jul 06 21:00:03.261976 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:03.261879 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75ad342-88e9-4f48-99b6-3bb5cc0d173a" containerName="seaweedfs-tls-custom" Jul 06 21:00:03.261976 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:03.261892 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75ad342-88e9-4f48-99b6-3bb5cc0d173a" containerName="seaweedfs-tls-custom" Jul 06 21:00:03.261976 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:03.261961 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75ad342-88e9-4f48-99b6-3bb5cc0d173a" containerName="seaweedfs-tls-custom" Jul 06 21:00:03.264626 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:03.264608 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-bcq9n" Jul 06 21:00:03.267829 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:03.267807 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-vpp4w\"" Jul 06 21:00:03.267977 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:03.267961 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 06 21:00:03.275478 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:03.275448 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-bcq9n"] Jul 06 21:00:03.390801 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:03.390760 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wfk2\" (UniqueName: \"kubernetes.io/projected/f18d575b-9263-4276-b447-856cdc91d5cb-kube-api-access-6wfk2\") pod \"s3-tls-init-custom-bcq9n\" (UID: \"f18d575b-9263-4276-b447-856cdc91d5cb\") " pod="kserve/s3-tls-init-custom-bcq9n" Jul 06 21:00:03.390986 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:03.390814 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f18d575b-9263-4276-b447-856cdc91d5cb-model-cache\") pod \"s3-tls-init-custom-bcq9n\" (UID: \"f18d575b-9263-4276-b447-856cdc91d5cb\") " pod="kserve/s3-tls-init-custom-bcq9n" Jul 06 21:00:03.492068 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:03.492025 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f18d575b-9263-4276-b447-856cdc91d5cb-model-cache\") pod \"s3-tls-init-custom-bcq9n\" (UID: \"f18d575b-9263-4276-b447-856cdc91d5cb\") " pod="kserve/s3-tls-init-custom-bcq9n" Jul 06 21:00:03.492274 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:03.492157 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wfk2\" (UniqueName: \"kubernetes.io/projected/f18d575b-9263-4276-b447-856cdc91d5cb-kube-api-access-6wfk2\") pod \"s3-tls-init-custom-bcq9n\" (UID: \"f18d575b-9263-4276-b447-856cdc91d5cb\") " pod="kserve/s3-tls-init-custom-bcq9n" Jul 06 21:00:03.492419 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:03.492399 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f18d575b-9263-4276-b447-856cdc91d5cb-model-cache\") pod \"s3-tls-init-custom-bcq9n\" (UID: \"f18d575b-9263-4276-b447-856cdc91d5cb\") " pod="kserve/s3-tls-init-custom-bcq9n" Jul 06 21:00:03.501599 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:03.501568 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wfk2\" (UniqueName: \"kubernetes.io/projected/f18d575b-9263-4276-b447-856cdc91d5cb-kube-api-access-6wfk2\") pod \"s3-tls-init-custom-bcq9n\" (UID: \"f18d575b-9263-4276-b447-856cdc91d5cb\") " pod="kserve/s3-tls-init-custom-bcq9n" Jul 06 21:00:03.582043 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:03.581945 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-bcq9n" Jul 06 21:00:03.731572 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:03.731540 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-bcq9n"] Jul 06 21:00:03.734625 ip-10-0-142-58 kubenswrapper[2586]: W0706 21:00:03.734599 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf18d575b_9263_4276_b447_856cdc91d5cb.slice/crio-8a28a03d06498beaf215be3f8b32536e825757fe518e1079ae05bd10cd8a0eb7 WatchSource:0}: Error finding container 8a28a03d06498beaf215be3f8b32536e825757fe518e1079ae05bd10cd8a0eb7: Status 404 returned error can't find the container with id 8a28a03d06498beaf215be3f8b32536e825757fe518e1079ae05bd10cd8a0eb7 Jul 06 21:00:04.038808 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:04.038767 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-bcq9n" event={"ID":"f18d575b-9263-4276-b447-856cdc91d5cb","Type":"ContainerStarted","Data":"39ee4c1900fb420d779636d9b1e8c88415de37070161cfcac9d6220e480a6c8c"} Jul 06 21:00:04.039743 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:04.039054 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-bcq9n" event={"ID":"f18d575b-9263-4276-b447-856cdc91d5cb","Type":"ContainerStarted","Data":"8a28a03d06498beaf215be3f8b32536e825757fe518e1079ae05bd10cd8a0eb7"} Jul 06 21:00:06.049006 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:06.048970 2586 generic.go:356] "Generic (PLEG): container finished" podID="f18d575b-9263-4276-b447-856cdc91d5cb" containerID="39ee4c1900fb420d779636d9b1e8c88415de37070161cfcac9d6220e480a6c8c" exitCode=0 Jul 06 21:00:06.049426 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:06.049024 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-bcq9n" event={"ID":"f18d575b-9263-4276-b447-856cdc91d5cb","Type":"ContainerDied","Data":"39ee4c1900fb420d779636d9b1e8c88415de37070161cfcac9d6220e480a6c8c"} Jul 06 21:00:07.055246 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:07.055206 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-bcq9n" event={"ID":"f18d575b-9263-4276-b447-856cdc91d5cb","Type":"ContainerStarted","Data":"1a86a0043c13cd84a60c84499e0c8d656ffb526898a61f7e5f1ad3a9e914e5ab"} Jul 06 21:00:07.076136 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:07.076061 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-custom-bcq9n" podStartSLOduration=2.355364584 podStartE2EDuration="4.076044028s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.720679444s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:00:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:00:07.075200885 +0000 UTC m=+688.409017398" watchObservedRunningTime="2026-07-06 21:00:07.076044028 +0000 UTC m=+688.409860539" Jul 06 21:00:13.083431 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:13.083395 2586 generic.go:356] "Generic (PLEG): container finished" podID="f18d575b-9263-4276-b447-856cdc91d5cb" containerID="1a86a0043c13cd84a60c84499e0c8d656ffb526898a61f7e5f1ad3a9e914e5ab" exitCode=0 Jul 06 21:00:13.083813 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:13.083473 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-bcq9n" event={"ID":"f18d575b-9263-4276-b447-856cdc91d5cb","Type":"ContainerDied","Data":"1a86a0043c13cd84a60c84499e0c8d656ffb526898a61f7e5f1ad3a9e914e5ab"} Jul 06 21:00:14.233249 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:14.233222 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-bcq9n" Jul 06 21:00:14.277384 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:14.277354 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wfk2\" (UniqueName: \"kubernetes.io/projected/f18d575b-9263-4276-b447-856cdc91d5cb-kube-api-access-6wfk2\") pod \"f18d575b-9263-4276-b447-856cdc91d5cb\" (UID: \"f18d575b-9263-4276-b447-856cdc91d5cb\") " Jul 06 21:00:14.277533 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:14.277435 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f18d575b-9263-4276-b447-856cdc91d5cb-model-cache\") pod \"f18d575b-9263-4276-b447-856cdc91d5cb\" (UID: \"f18d575b-9263-4276-b447-856cdc91d5cb\") " Jul 06 21:00:14.279389 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:14.279363 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f18d575b-9263-4276-b447-856cdc91d5cb-kube-api-access-6wfk2" (OuterVolumeSpecName: "kube-api-access-6wfk2") pod "f18d575b-9263-4276-b447-856cdc91d5cb" (UID: "f18d575b-9263-4276-b447-856cdc91d5cb"). InnerVolumeSpecName "kube-api-access-6wfk2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:00:14.304542 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:14.304503 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f18d575b-9263-4276-b447-856cdc91d5cb-model-cache" (OuterVolumeSpecName: "model-cache") pod "f18d575b-9263-4276-b447-856cdc91d5cb" (UID: "f18d575b-9263-4276-b447-856cdc91d5cb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:00:14.378401 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:14.378328 2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f18d575b-9263-4276-b447-856cdc91d5cb-model-cache\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 21:00:14.378401 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:14.378357 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wfk2\" (UniqueName: \"kubernetes.io/projected/f18d575b-9263-4276-b447-856cdc91d5cb-kube-api-access-6wfk2\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 21:00:15.094198 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:15.094166 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-bcq9n" Jul 06 21:00:15.094380 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:15.094165 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-bcq9n" event={"ID":"f18d575b-9263-4276-b447-856cdc91d5cb","Type":"ContainerDied","Data":"8a28a03d06498beaf215be3f8b32536e825757fe518e1079ae05bd10cd8a0eb7"} Jul 06 21:00:15.094380 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:15.094290 2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a28a03d06498beaf215be3f8b32536e825757fe518e1079ae05bd10cd8a0eb7" Jul 06 21:00:21.359659 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.359628 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-serving-4vhpw"] Jul 06 21:00:21.360095 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.359949 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f18d575b-9263-4276-b447-856cdc91d5cb" containerName="download-hf-model" Jul 06 21:00:21.360095 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.359960 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="f18d575b-9263-4276-b447-856cdc91d5cb" containerName="download-hf-model" Jul 06 21:00:21.360095 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.359978 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f18d575b-9263-4276-b447-856cdc91d5cb" containerName="s3-tls-init-custom" Jul 06 21:00:21.360095 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.359983 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="f18d575b-9263-4276-b447-856cdc91d5cb" containerName="s3-tls-init-custom" Jul 06 21:00:21.360095 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.360045 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="f18d575b-9263-4276-b447-856cdc91d5cb" containerName="s3-tls-init-custom" Jul 06 21:00:21.363601 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.363584 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-4vhpw" Jul 06 21:00:21.366624 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.366600 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-vpp4w\"" Jul 06 21:00:21.366864 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.366845 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 06 21:00:21.375983 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.375952 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-4vhpw"] Jul 06 21:00:21.433284 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.433250 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djt6k\" (UniqueName: \"kubernetes.io/projected/3ffc46d1-76a2-4e72-991d-15f8469ea91c-kube-api-access-djt6k\") pod \"s3-tls-init-serving-4vhpw\" (UID: \"3ffc46d1-76a2-4e72-991d-15f8469ea91c\") " pod="kserve/s3-tls-init-serving-4vhpw" Jul 06 21:00:21.433284 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.433297 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ffc46d1-76a2-4e72-991d-15f8469ea91c-model-cache\") pod \"s3-tls-init-serving-4vhpw\" (UID: \"3ffc46d1-76a2-4e72-991d-15f8469ea91c\") " pod="kserve/s3-tls-init-serving-4vhpw" Jul 06 21:00:21.534330 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.534282 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ffc46d1-76a2-4e72-991d-15f8469ea91c-model-cache\") pod \"s3-tls-init-serving-4vhpw\" (UID: \"3ffc46d1-76a2-4e72-991d-15f8469ea91c\") " pod="kserve/s3-tls-init-serving-4vhpw" Jul 06 21:00:21.534508 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.534381 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djt6k\" (UniqueName: \"kubernetes.io/projected/3ffc46d1-76a2-4e72-991d-15f8469ea91c-kube-api-access-djt6k\") pod \"s3-tls-init-serving-4vhpw\" (UID: \"3ffc46d1-76a2-4e72-991d-15f8469ea91c\") " pod="kserve/s3-tls-init-serving-4vhpw" Jul 06 21:00:21.534643 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.534622 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ffc46d1-76a2-4e72-991d-15f8469ea91c-model-cache\") pod \"s3-tls-init-serving-4vhpw\" (UID: \"3ffc46d1-76a2-4e72-991d-15f8469ea91c\") " pod="kserve/s3-tls-init-serving-4vhpw" Jul 06 21:00:21.546415 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.546385 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djt6k\" (UniqueName: \"kubernetes.io/projected/3ffc46d1-76a2-4e72-991d-15f8469ea91c-kube-api-access-djt6k\") pod \"s3-tls-init-serving-4vhpw\" (UID: \"3ffc46d1-76a2-4e72-991d-15f8469ea91c\") " pod="kserve/s3-tls-init-serving-4vhpw" Jul 06 21:00:21.688745 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.688711 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-4vhpw" Jul 06 21:00:21.839665 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:21.839638 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-4vhpw"] Jul 06 21:00:21.842510 ip-10-0-142-58 kubenswrapper[2586]: W0706 21:00:21.842479 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ffc46d1_76a2_4e72_991d_15f8469ea91c.slice/crio-3fa890cfb693e1626ad4da9900dac9afdce58dedea1aacdbaf4fa2a5bfb1f303 WatchSource:0}: Error finding container 3fa890cfb693e1626ad4da9900dac9afdce58dedea1aacdbaf4fa2a5bfb1f303: Status 404 returned error can't find the container with id 3fa890cfb693e1626ad4da9900dac9afdce58dedea1aacdbaf4fa2a5bfb1f303 Jul 06 21:00:22.124744 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:22.124650 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-4vhpw" event={"ID":"3ffc46d1-76a2-4e72-991d-15f8469ea91c","Type":"ContainerStarted","Data":"98c2cc615a36c85cc8f5659a6cda4921d0c10275b2173c468741554b780526ef"} Jul 06 21:00:22.124744 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:22.124702 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-4vhpw" event={"ID":"3ffc46d1-76a2-4e72-991d-15f8469ea91c","Type":"ContainerStarted","Data":"3fa890cfb693e1626ad4da9900dac9afdce58dedea1aacdbaf4fa2a5bfb1f303"} Jul 06 21:00:24.136682 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:24.136649 2586 generic.go:356] "Generic (PLEG): container finished" podID="3ffc46d1-76a2-4e72-991d-15f8469ea91c" containerID="98c2cc615a36c85cc8f5659a6cda4921d0c10275b2173c468741554b780526ef" exitCode=0 Jul 06 21:00:24.137038 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:24.136723 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-4vhpw" event={"ID":"3ffc46d1-76a2-4e72-991d-15f8469ea91c","Type":"ContainerDied","Data":"98c2cc615a36c85cc8f5659a6cda4921d0c10275b2173c468741554b780526ef"} Jul 06 21:00:25.142248 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:25.142214 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-4vhpw" event={"ID":"3ffc46d1-76a2-4e72-991d-15f8469ea91c","Type":"ContainerStarted","Data":"72bde07e537d8fd9904760c0971e8b0de0daea9147b3ff4bcf8d38307f95a550"} Jul 06 21:00:32.176063 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:32.176017 2586 generic.go:356] "Generic (PLEG): container finished" podID="3ffc46d1-76a2-4e72-991d-15f8469ea91c" containerID="72bde07e537d8fd9904760c0971e8b0de0daea9147b3ff4bcf8d38307f95a550" exitCode=0 Jul 06 21:00:32.176575 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:32.176111 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-4vhpw" event={"ID":"3ffc46d1-76a2-4e72-991d-15f8469ea91c","Type":"ContainerDied","Data":"72bde07e537d8fd9904760c0971e8b0de0daea9147b3ff4bcf8d38307f95a550"} Jul 06 21:00:33.325710 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:33.325680 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-4vhpw" Jul 06 21:00:33.442965 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:33.442873 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ffc46d1-76a2-4e72-991d-15f8469ea91c-model-cache\") pod \"3ffc46d1-76a2-4e72-991d-15f8469ea91c\" (UID: \"3ffc46d1-76a2-4e72-991d-15f8469ea91c\") " Jul 06 21:00:33.442965 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:33.442954 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djt6k\" (UniqueName: \"kubernetes.io/projected/3ffc46d1-76a2-4e72-991d-15f8469ea91c-kube-api-access-djt6k\") pod \"3ffc46d1-76a2-4e72-991d-15f8469ea91c\" (UID: \"3ffc46d1-76a2-4e72-991d-15f8469ea91c\") " Jul 06 21:00:33.445012 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:33.444974 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ffc46d1-76a2-4e72-991d-15f8469ea91c-kube-api-access-djt6k" (OuterVolumeSpecName: "kube-api-access-djt6k") pod "3ffc46d1-76a2-4e72-991d-15f8469ea91c" (UID: "3ffc46d1-76a2-4e72-991d-15f8469ea91c"). InnerVolumeSpecName "kube-api-access-djt6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:00:33.464513 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:33.464475 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ffc46d1-76a2-4e72-991d-15f8469ea91c-model-cache" (OuterVolumeSpecName: "model-cache") pod "3ffc46d1-76a2-4e72-991d-15f8469ea91c" (UID: "3ffc46d1-76a2-4e72-991d-15f8469ea91c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:00:33.543662 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:33.543614 2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ffc46d1-76a2-4e72-991d-15f8469ea91c-model-cache\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 21:00:33.543662 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:33.543652 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djt6k\" (UniqueName: \"kubernetes.io/projected/3ffc46d1-76a2-4e72-991d-15f8469ea91c-kube-api-access-djt6k\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 21:00:34.186431 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:34.186398 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-4vhpw" event={"ID":"3ffc46d1-76a2-4e72-991d-15f8469ea91c","Type":"ContainerDied","Data":"3fa890cfb693e1626ad4da9900dac9afdce58dedea1aacdbaf4fa2a5bfb1f303"} Jul 06 21:00:34.186431 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:34.186418 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-4vhpw" Jul 06 21:00:34.186431 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:34.186435 2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3fa890cfb693e1626ad4da9900dac9afdce58dedea1aacdbaf4fa2a5bfb1f303" Jul 06 21:00:47.503786 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.503747 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x4lsf/must-gather-dr7fb"] Jul 06 21:00:47.504204 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.504089 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ffc46d1-76a2-4e72-991d-15f8469ea91c" containerName="download-hf-model" Jul 06 21:00:47.504204 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.504105 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ffc46d1-76a2-4e72-991d-15f8469ea91c" containerName="download-hf-model" Jul 06 21:00:47.504204 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.504117 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ffc46d1-76a2-4e72-991d-15f8469ea91c" containerName="s3-tls-init-serving" Jul 06 21:00:47.504204 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.504123 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ffc46d1-76a2-4e72-991d-15f8469ea91c" containerName="s3-tls-init-serving" Jul 06 21:00:47.504204 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.504181 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ffc46d1-76a2-4e72-991d-15f8469ea91c" containerName="s3-tls-init-serving" Jul 06 21:00:47.506766 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.506746 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4lsf/must-gather-dr7fb" Jul 06 21:00:47.510682 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.510660 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x4lsf\"/\"openshift-service-ca.crt\"" Jul 06 21:00:47.510782 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.510693 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x4lsf\"/\"kube-root-ca.crt\"" Jul 06 21:00:47.510839 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.510798 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x4lsf\"/\"default-dockercfg-c799m\"" Jul 06 21:00:47.519029 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.518995 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4lsf/must-gather-dr7fb"] Jul 06 21:00:47.666988 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.666947 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6e58a4a5-ef0d-4683-b53b-340c57b8f2df-must-gather-output\") pod \"must-gather-dr7fb\" (UID: \"6e58a4a5-ef0d-4683-b53b-340c57b8f2df\") " pod="openshift-must-gather-x4lsf/must-gather-dr7fb" Jul 06 21:00:47.667197 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.667107 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl6l7\" (UniqueName: \"kubernetes.io/projected/6e58a4a5-ef0d-4683-b53b-340c57b8f2df-kube-api-access-dl6l7\") pod \"must-gather-dr7fb\" (UID: \"6e58a4a5-ef0d-4683-b53b-340c57b8f2df\") " pod="openshift-must-gather-x4lsf/must-gather-dr7fb" Jul 06 21:00:47.768061 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.767947 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl6l7\" (UniqueName: \"kubernetes.io/projected/6e58a4a5-ef0d-4683-b53b-340c57b8f2df-kube-api-access-dl6l7\") pod \"must-gather-dr7fb\" (UID: \"6e58a4a5-ef0d-4683-b53b-340c57b8f2df\") " pod="openshift-must-gather-x4lsf/must-gather-dr7fb" Jul 06 21:00:47.768061 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.768010 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6e58a4a5-ef0d-4683-b53b-340c57b8f2df-must-gather-output\") pod \"must-gather-dr7fb\" (UID: \"6e58a4a5-ef0d-4683-b53b-340c57b8f2df\") " pod="openshift-must-gather-x4lsf/must-gather-dr7fb" Jul 06 21:00:47.768369 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.768336 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6e58a4a5-ef0d-4683-b53b-340c57b8f2df-must-gather-output\") pod \"must-gather-dr7fb\" (UID: \"6e58a4a5-ef0d-4683-b53b-340c57b8f2df\") " pod="openshift-must-gather-x4lsf/must-gather-dr7fb" Jul 06 21:00:47.777997 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.777973 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl6l7\" (UniqueName: \"kubernetes.io/projected/6e58a4a5-ef0d-4683-b53b-340c57b8f2df-kube-api-access-dl6l7\") pod \"must-gather-dr7fb\" (UID: \"6e58a4a5-ef0d-4683-b53b-340c57b8f2df\") " pod="openshift-must-gather-x4lsf/must-gather-dr7fb" Jul 06 21:00:47.827279 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.827238 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4lsf/must-gather-dr7fb" Jul 06 21:00:47.964864 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:47.964839 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4lsf/must-gather-dr7fb"] Jul 06 21:00:47.967839 ip-10-0-142-58 kubenswrapper[2586]: W0706 21:00:47.967792 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e58a4a5_ef0d_4683_b53b_340c57b8f2df.slice/crio-958ceff4536b9aa293b9e09288878994dc463a5ade32f3d95689f323e0115cbb WatchSource:0}: Error finding container 958ceff4536b9aa293b9e09288878994dc463a5ade32f3d95689f323e0115cbb: Status 404 returned error can't find the container with id 958ceff4536b9aa293b9e09288878994dc463a5ade32f3d95689f323e0115cbb Jul 06 21:00:48.243626 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:48.243587 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4lsf/must-gather-dr7fb" event={"ID":"6e58a4a5-ef0d-4683-b53b-340c57b8f2df","Type":"ContainerStarted","Data":"958ceff4536b9aa293b9e09288878994dc463a5ade32f3d95689f323e0115cbb"} Jul 06 21:00:55.282248 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:55.282197 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4lsf/must-gather-dr7fb" event={"ID":"6e58a4a5-ef0d-4683-b53b-340c57b8f2df","Type":"ContainerStarted","Data":"613e418fd0ce9b14907d8a11ccd5cc9834e3989584ea9e1ff9ebe3957712b13b"} Jul 06 21:00:55.282810 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:55.282261 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4lsf/must-gather-dr7fb" event={"ID":"6e58a4a5-ef0d-4683-b53b-340c57b8f2df","Type":"ContainerStarted","Data":"4908af13833778224f5924e3c1e1a919e0190e848548bebc044a11032589cf8a"} Jul 06 21:00:55.307711 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:00:55.307645 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x4lsf/must-gather-dr7fb" podStartSLOduration=1.993803499 podStartE2EDuration="8.307625367s" totalImagesPullingTime="6.313821868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:00:55.306872521 +0000 UTC m=+736.640689033" watchObservedRunningTime="2026-07-06 21:00:55.307625367 +0000 UTC m=+736.641441883" Jul 06 21:01:13.368695 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:13.368663 2586 generic.go:356] "Generic (PLEG): container finished" podID="6e58a4a5-ef0d-4683-b53b-340c57b8f2df" containerID="4908af13833778224f5924e3c1e1a919e0190e848548bebc044a11032589cf8a" exitCode=0 Jul 06 21:01:13.369210 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:13.368726 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4lsf/must-gather-dr7fb" event={"ID":"6e58a4a5-ef0d-4683-b53b-340c57b8f2df","Type":"ContainerDied","Data":"4908af13833778224f5924e3c1e1a919e0190e848548bebc044a11032589cf8a"} Jul 06 21:01:13.369210 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:13.369063 2586 scope.go:117] "RemoveContainer" containerID="4908af13833778224f5924e3c1e1a919e0190e848548bebc044a11032589cf8a" Jul 06 21:01:14.347311 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:14.347276 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-x4lsf_must-gather-dr7fb_6e58a4a5-ef0d-4683-b53b-340c57b8f2df/gather/0.log" Jul 06 21:01:14.919945 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:14.919913 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rxdn5/must-gather-nmr6r"] Jul 06 21:01:14.922318 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:14.922300 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rxdn5/must-gather-nmr6r" Jul 06 21:01:14.925159 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:14.925135 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rxdn5\"/\"kube-root-ca.crt\"" Jul 06 21:01:14.926010 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:14.925994 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rxdn5\"/\"default-dockercfg-kwwz2\"" Jul 06 21:01:14.926069 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:14.926050 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rxdn5\"/\"openshift-service-ca.crt\"" Jul 06 21:01:14.936327 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:14.936300 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rxdn5/must-gather-nmr6r"] Jul 06 21:01:15.011398 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:15.011347 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c73ea276-c7c5-4466-8516-723ba96deb81-must-gather-output\") pod \"must-gather-nmr6r\" (UID: \"c73ea276-c7c5-4466-8516-723ba96deb81\") " pod="openshift-must-gather-rxdn5/must-gather-nmr6r" Jul 06 21:01:15.011574 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:15.011426 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clqp6\" (UniqueName: \"kubernetes.io/projected/c73ea276-c7c5-4466-8516-723ba96deb81-kube-api-access-clqp6\") pod \"must-gather-nmr6r\" (UID: \"c73ea276-c7c5-4466-8516-723ba96deb81\") " pod="openshift-must-gather-rxdn5/must-gather-nmr6r" Jul 06 21:01:15.112926 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:15.112882 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c73ea276-c7c5-4466-8516-723ba96deb81-must-gather-output\") pod \"must-gather-nmr6r\" (UID: \"c73ea276-c7c5-4466-8516-723ba96deb81\") " pod="openshift-must-gather-rxdn5/must-gather-nmr6r" Jul 06 21:01:15.113161 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:15.112949 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clqp6\" (UniqueName: \"kubernetes.io/projected/c73ea276-c7c5-4466-8516-723ba96deb81-kube-api-access-clqp6\") pod \"must-gather-nmr6r\" (UID: \"c73ea276-c7c5-4466-8516-723ba96deb81\") " pod="openshift-must-gather-rxdn5/must-gather-nmr6r" Jul 06 21:01:15.113314 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:15.113285 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c73ea276-c7c5-4466-8516-723ba96deb81-must-gather-output\") pod \"must-gather-nmr6r\" (UID: \"c73ea276-c7c5-4466-8516-723ba96deb81\") " pod="openshift-must-gather-rxdn5/must-gather-nmr6r" Jul 06 21:01:15.122208 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:15.122183 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clqp6\" (UniqueName: \"kubernetes.io/projected/c73ea276-c7c5-4466-8516-723ba96deb81-kube-api-access-clqp6\") pod \"must-gather-nmr6r\" (UID: \"c73ea276-c7c5-4466-8516-723ba96deb81\") " pod="openshift-must-gather-rxdn5/must-gather-nmr6r" Jul 06 21:01:15.232309 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:15.232204 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rxdn5/must-gather-nmr6r" Jul 06 21:01:15.366729 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:15.366693 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rxdn5/must-gather-nmr6r"] Jul 06 21:01:15.369617 ip-10-0-142-58 kubenswrapper[2586]: W0706 21:01:15.369589 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc73ea276_c7c5_4466_8516_723ba96deb81.slice/crio-ec8de968e4db33d5cf08aed77807c1077c824d949898517317b244863da4293b WatchSource:0}: Error finding container ec8de968e4db33d5cf08aed77807c1077c824d949898517317b244863da4293b: Status 404 returned error can't find the container with id ec8de968e4db33d5cf08aed77807c1077c824d949898517317b244863da4293b Jul 06 21:01:15.379136 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:15.379109 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rxdn5/must-gather-nmr6r" event={"ID":"c73ea276-c7c5-4466-8516-723ba96deb81","Type":"ContainerStarted","Data":"ec8de968e4db33d5cf08aed77807c1077c824d949898517317b244863da4293b"} Jul 06 21:01:16.385941 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:16.385902 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rxdn5/must-gather-nmr6r" event={"ID":"c73ea276-c7c5-4466-8516-723ba96deb81","Type":"ContainerStarted","Data":"cab005f4ac44b13f67f09a601e4a57eb7b9ac285efc1fe86b52e4535b09d8c53"} Jul 06 21:01:16.386400 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:16.385950 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rxdn5/must-gather-nmr6r" event={"ID":"c73ea276-c7c5-4466-8516-723ba96deb81","Type":"ContainerStarted","Data":"0b8d3593b185633d1849e00028da5d786d6613a3123fe6d230e58ae306daba51"} Jul 06 21:01:16.407770 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:16.407715 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rxdn5/must-gather-nmr6r" podStartSLOduration=1.6370000340000002 podStartE2EDuration="2.407692446s" totalImagesPullingTime="770.692412ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:01:16.405471011 +0000 UTC m=+757.739287523" watchObservedRunningTime="2026-07-06 21:01:16.407692446 +0000 UTC m=+757.741508959" Jul 06 21:01:17.769475 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:17.769445 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s4cpg_01a651e4-e3a5-4a70-870d-9ed3c9bfacb9/global-pull-secret-syncer/0.log" Jul 06 21:01:17.858361 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:17.858304 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qvt6g_1d418585-bb7c-41bd-ac8f-56bfaf494254/konnectivity-agent/0.log" Jul 06 21:01:17.986952 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:17.986918 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-58.ec2.internal_93c5fe6b20d1f802096a59c4920e1e2c/haproxy/0.log" Jul 06 21:01:19.753409 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:19.753359 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-x4lsf/must-gather-dr7fb"] Jul 06 21:01:19.753976 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:19.753941 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-x4lsf/must-gather-dr7fb" podUID="6e58a4a5-ef0d-4683-b53b-340c57b8f2df" containerName="copy" containerID="cri-o://613e418fd0ce9b14907d8a11ccd5cc9834e3989584ea9e1ff9ebe3957712b13b" gracePeriod=2 Jul 06 21:01:19.762265 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:19.762235 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-x4lsf/must-gather-dr7fb"] Jul 06 21:01:20.134718 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:20.134674 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-x4lsf_must-gather-dr7fb_6e58a4a5-ef0d-4683-b53b-340c57b8f2df/copy/0.log" Jul 06 21:01:20.144065 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:20.143778 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4lsf/must-gather-dr7fb" Jul 06 21:01:20.146536 ip-10-0-142-58 kubenswrapper[2586]: E0706 21:01:20.146486 2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-dr7fb\" is forbidden: User \"system:node:ip-10-0-142-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-x4lsf\": no relationship found between node 'ip-10-0-142-58.ec2.internal' and this object" podUID="6e58a4a5-ef0d-4683-b53b-340c57b8f2df" pod="openshift-must-gather-x4lsf/must-gather-dr7fb" Jul 06 21:01:20.159644 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:20.159569 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dl6l7\" (UniqueName: \"kubernetes.io/projected/6e58a4a5-ef0d-4683-b53b-340c57b8f2df-kube-api-access-dl6l7\") pod \"6e58a4a5-ef0d-4683-b53b-340c57b8f2df\" (UID: \"6e58a4a5-ef0d-4683-b53b-340c57b8f2df\") " Jul 06 21:01:20.159956 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:20.159926 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6e58a4a5-ef0d-4683-b53b-340c57b8f2df-must-gather-output\") pod \"6e58a4a5-ef0d-4683-b53b-340c57b8f2df\" (UID: \"6e58a4a5-ef0d-4683-b53b-340c57b8f2df\") " Jul 06 21:01:20.161398 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:20.161353 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e58a4a5-ef0d-4683-b53b-340c57b8f2df-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "6e58a4a5-ef0d-4683-b53b-340c57b8f2df" (UID: "6e58a4a5-ef0d-4683-b53b-340c57b8f2df"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:01:20.170101 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:20.166630 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e58a4a5-ef0d-4683-b53b-340c57b8f2df-kube-api-access-dl6l7" (OuterVolumeSpecName: "kube-api-access-dl6l7") pod "6e58a4a5-ef0d-4683-b53b-340c57b8f2df" (UID: "6e58a4a5-ef0d-4683-b53b-340c57b8f2df"). InnerVolumeSpecName "kube-api-access-dl6l7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:01:20.262037 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:20.261971 2586 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6e58a4a5-ef0d-4683-b53b-340c57b8f2df-must-gather-output\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 21:01:20.262037 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:20.262011 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl6l7\" (UniqueName: \"kubernetes.io/projected/6e58a4a5-ef0d-4683-b53b-340c57b8f2df-kube-api-access-dl6l7\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" Jul 06 21:01:20.417005 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:20.416968 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-x4lsf_must-gather-dr7fb_6e58a4a5-ef0d-4683-b53b-340c57b8f2df/copy/0.log" Jul 06 21:01:20.417452 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:20.417423 2586 generic.go:356] "Generic (PLEG): container finished" podID="6e58a4a5-ef0d-4683-b53b-340c57b8f2df" containerID="613e418fd0ce9b14907d8a11ccd5cc9834e3989584ea9e1ff9ebe3957712b13b" exitCode=143 Jul 06 21:01:20.417559 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:20.417545 2586 scope.go:117] "RemoveContainer" containerID="613e418fd0ce9b14907d8a11ccd5cc9834e3989584ea9e1ff9ebe3957712b13b" Jul 06 21:01:20.417742 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:20.417725 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4lsf/must-gather-dr7fb" Jul 06 21:01:20.421785 ip-10-0-142-58 kubenswrapper[2586]: E0706 21:01:20.421540 2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-dr7fb\" is forbidden: User \"system:node:ip-10-0-142-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-x4lsf\": no relationship found between node 'ip-10-0-142-58.ec2.internal' and this object" podUID="6e58a4a5-ef0d-4683-b53b-340c57b8f2df" pod="openshift-must-gather-x4lsf/must-gather-dr7fb" Jul 06 21:01:20.437565 ip-10-0-142-58 kubenswrapper[2586]: E0706 21:01:20.437519 2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-dr7fb\" is forbidden: User \"system:node:ip-10-0-142-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-x4lsf\": no relationship found between node 'ip-10-0-142-58.ec2.internal' and this object" podUID="6e58a4a5-ef0d-4683-b53b-340c57b8f2df" pod="openshift-must-gather-x4lsf/must-gather-dr7fb" Jul 06 21:01:20.445311 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:20.444559 2586 scope.go:117] "RemoveContainer" containerID="4908af13833778224f5924e3c1e1a919e0190e848548bebc044a11032589cf8a" Jul 06 21:01:20.472321 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:20.472060 2586 scope.go:117] "RemoveContainer" containerID="613e418fd0ce9b14907d8a11ccd5cc9834e3989584ea9e1ff9ebe3957712b13b" Jul 06 21:01:20.474168 ip-10-0-142-58 kubenswrapper[2586]: E0706 21:01:20.472781 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"613e418fd0ce9b14907d8a11ccd5cc9834e3989584ea9e1ff9ebe3957712b13b\": container with ID starting with 613e418fd0ce9b14907d8a11ccd5cc9834e3989584ea9e1ff9ebe3957712b13b not found: ID does not exist" containerID="613e418fd0ce9b14907d8a11ccd5cc9834e3989584ea9e1ff9ebe3957712b13b" Jul 06 21:01:20.474168 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:20.472853 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"613e418fd0ce9b14907d8a11ccd5cc9834e3989584ea9e1ff9ebe3957712b13b"} err="failed to get container status \"613e418fd0ce9b14907d8a11ccd5cc9834e3989584ea9e1ff9ebe3957712b13b\": rpc error: code = NotFound desc = could not find container \"613e418fd0ce9b14907d8a11ccd5cc9834e3989584ea9e1ff9ebe3957712b13b\": container with ID starting with 613e418fd0ce9b14907d8a11ccd5cc9834e3989584ea9e1ff9ebe3957712b13b not found: ID does not exist" Jul 06 21:01:20.474168 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:20.472899 2586 scope.go:117] "RemoveContainer" containerID="4908af13833778224f5924e3c1e1a919e0190e848548bebc044a11032589cf8a" Jul 06 21:01:20.474168 ip-10-0-142-58 kubenswrapper[2586]: E0706 21:01:20.473297 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4908af13833778224f5924e3c1e1a919e0190e848548bebc044a11032589cf8a\": container with ID starting with 4908af13833778224f5924e3c1e1a919e0190e848548bebc044a11032589cf8a not found: ID does not exist" containerID="4908af13833778224f5924e3c1e1a919e0190e848548bebc044a11032589cf8a" Jul 06 21:01:20.474168 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:20.473327 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4908af13833778224f5924e3c1e1a919e0190e848548bebc044a11032589cf8a"} err="failed to get container status \"4908af13833778224f5924e3c1e1a919e0190e848548bebc044a11032589cf8a\": rpc error: code = NotFound desc = could not find container \"4908af13833778224f5924e3c1e1a919e0190e848548bebc044a11032589cf8a\": container with ID starting with 4908af13833778224f5924e3c1e1a919e0190e848548bebc044a11032589cf8a not found: ID does not exist" Jul 06 21:01:21.217217 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:21.217179 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e58a4a5-ef0d-4683-b53b-340c57b8f2df" path="/var/lib/kubelet/pods/6e58a4a5-ef0d-4683-b53b-340c57b8f2df/volumes" Jul 06 21:01:21.872154 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:21.872123 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d485bb4e-f676-41c1-88fa-7721371121d8/alertmanager/0.log" Jul 06 21:01:21.919125 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:21.919099 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d485bb4e-f676-41c1-88fa-7721371121d8/config-reloader/0.log" Jul 06 21:01:21.955822 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:21.955772 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d485bb4e-f676-41c1-88fa-7721371121d8/kube-rbac-proxy-web/0.log" Jul 06 21:01:21.991885 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:21.991841 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d485bb4e-f676-41c1-88fa-7721371121d8/kube-rbac-proxy/0.log" Jul 06 21:01:22.031005 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:22.030958 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d485bb4e-f676-41c1-88fa-7721371121d8/kube-rbac-proxy-metric/0.log" Jul 06 21:01:22.061436 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:22.061399 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d485bb4e-f676-41c1-88fa-7721371121d8/prom-label-proxy/0.log" Jul 06 21:01:22.106690 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:22.106655 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d485bb4e-f676-41c1-88fa-7721371121d8/init-config-reloader/0.log" Jul 06 21:01:22.181390 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:22.181365 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-8sdtb_a4d8713b-e22f-4b14-9f60-0d3828631a89/kube-state-metrics/0.log" Jul 06 21:01:22.218549 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:22.218522 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-8sdtb_a4d8713b-e22f-4b14-9f60-0d3828631a89/kube-rbac-proxy-main/0.log" Jul 06 21:01:22.255548 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:22.255500 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-8sdtb_a4d8713b-e22f-4b14-9f60-0d3828631a89/kube-rbac-proxy-self/0.log" Jul 06 21:01:22.708519 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:22.708489 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k88pb_eb3675c5-0128-4724-a601-e70d773a29d3/node-exporter/0.log" Jul 06 21:01:22.741017 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:22.740982 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k88pb_eb3675c5-0128-4724-a601-e70d773a29d3/kube-rbac-proxy/0.log" Jul 06 21:01:22.770145 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:22.770112 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k88pb_eb3675c5-0128-4724-a601-e70d773a29d3/init-textfile/0.log" Jul 06 21:01:22.803263 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:22.803224 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-jr8km_996eb26e-3964-4408-b19b-dc22f09e9cfa/kube-rbac-proxy-main/0.log" Jul 06 21:01:22.840597 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:22.840561 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-jr8km_996eb26e-3964-4408-b19b-dc22f09e9cfa/kube-rbac-proxy-self/0.log" Jul 06 21:01:22.872390 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:22.872347 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-jr8km_996eb26e-3964-4408-b19b-dc22f09e9cfa/openshift-state-metrics/0.log" Jul 06 21:01:22.915818 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:22.915781 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4bbf1894-5eb8-490b-9f74-f9221ae80e34/prometheus/0.log" Jul 06 21:01:22.944782 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:22.944756 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4bbf1894-5eb8-490b-9f74-f9221ae80e34/config-reloader/0.log" Jul 06 21:01:22.973029 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:22.972997 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4bbf1894-5eb8-490b-9f74-f9221ae80e34/thanos-sidecar/0.log" Jul 06 21:01:23.004129 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:23.004101 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4bbf1894-5eb8-490b-9f74-f9221ae80e34/kube-rbac-proxy-web/0.log" Jul 06 21:01:23.040246 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:23.040218 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4bbf1894-5eb8-490b-9f74-f9221ae80e34/kube-rbac-proxy/0.log" Jul 06 21:01:23.076396 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:23.076364 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4bbf1894-5eb8-490b-9f74-f9221ae80e34/kube-rbac-proxy-thanos/0.log" Jul 06 21:01:23.117726 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:23.117697 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4bbf1894-5eb8-490b-9f74-f9221ae80e34/init-config-reloader/0.log" Jul 06 21:01:23.305782 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:23.305691 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-x766l_82a473cb-618d-4588-8618-f9c6521f2024/prometheus-operator-admission-webhook/0.log" Jul 06 21:01:23.359905 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:23.359872 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bfd5876d4-2v8bj_d9b29353-5be0-4275-85c1-52686e36de42/telemeter-client/0.log" Jul 06 21:01:23.397486 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:23.397452 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bfd5876d4-2v8bj_d9b29353-5be0-4275-85c1-52686e36de42/reload/0.log" Jul 06 21:01:23.433991 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:23.433957 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bfd5876d4-2v8bj_d9b29353-5be0-4275-85c1-52686e36de42/kube-rbac-proxy/0.log" Jul 06 21:01:24.895227 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:24.895190 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-wjl9z_42d8a7a5-43b6-4bf6-8c62-9491dffcd31a/networking-console-plugin/0.log" Jul 06 21:01:25.444882 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:25.444851 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fxmcj_5ec4b5d3-3779-4781-809d-da31fe3a5c6c/console-operator/2.log" Jul 06 21:01:25.452894 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:25.452864 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fxmcj_5ec4b5d3-3779-4781-809d-da31fe3a5c6c/console-operator/3.log" Jul 06 21:01:26.578630 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.578596 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6"] Jul 06 21:01:26.579116 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.579101 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e58a4a5-ef0d-4683-b53b-340c57b8f2df" containerName="gather" Jul 06 21:01:26.579193 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.579122 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e58a4a5-ef0d-4683-b53b-340c57b8f2df" containerName="gather" Jul 06 21:01:26.579193 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.579166 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e58a4a5-ef0d-4683-b53b-340c57b8f2df" containerName="copy" Jul 06 21:01:26.579193 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.579176 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e58a4a5-ef0d-4683-b53b-340c57b8f2df" containerName="copy" Jul 06 21:01:26.579336 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.579259 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e58a4a5-ef0d-4683-b53b-340c57b8f2df" containerName="gather" Jul 06 21:01:26.579336 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.579278 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e58a4a5-ef0d-4683-b53b-340c57b8f2df" containerName="copy" Jul 06 21:01:26.583658 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.583635 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:26.602088 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.602043 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6"] Jul 06 21:01:26.635737 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.635691 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c722f10a-fb45-4208-ab19-9f28adf7e421-proc\") pod \"perf-node-gather-daemonset-md4g6\" (UID: \"c722f10a-fb45-4208-ab19-9f28adf7e421\") " pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:26.636038 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.636009 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c722f10a-fb45-4208-ab19-9f28adf7e421-lib-modules\") pod \"perf-node-gather-daemonset-md4g6\" (UID: \"c722f10a-fb45-4208-ab19-9f28adf7e421\") " pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:26.636185 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.636051 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c722f10a-fb45-4208-ab19-9f28adf7e421-podres\") pod \"perf-node-gather-daemonset-md4g6\" (UID: \"c722f10a-fb45-4208-ab19-9f28adf7e421\") " pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:26.636185 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.636096 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw59d\" (UniqueName: \"kubernetes.io/projected/c722f10a-fb45-4208-ab19-9f28adf7e421-kube-api-access-zw59d\") pod \"perf-node-gather-daemonset-md4g6\" (UID: \"c722f10a-fb45-4208-ab19-9f28adf7e421\") " pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:26.636317 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.636219 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c722f10a-fb45-4208-ab19-9f28adf7e421-sys\") pod \"perf-node-gather-daemonset-md4g6\" (UID: \"c722f10a-fb45-4208-ab19-9f28adf7e421\") " pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:26.737593 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.737556 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c722f10a-fb45-4208-ab19-9f28adf7e421-lib-modules\") pod \"perf-node-gather-daemonset-md4g6\" (UID: \"c722f10a-fb45-4208-ab19-9f28adf7e421\") " pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:26.737593 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.737597 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c722f10a-fb45-4208-ab19-9f28adf7e421-podres\") pod \"perf-node-gather-daemonset-md4g6\" (UID: \"c722f10a-fb45-4208-ab19-9f28adf7e421\") " pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:26.737852 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.737614 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw59d\" (UniqueName: \"kubernetes.io/projected/c722f10a-fb45-4208-ab19-9f28adf7e421-kube-api-access-zw59d\") pod \"perf-node-gather-daemonset-md4g6\" (UID: \"c722f10a-fb45-4208-ab19-9f28adf7e421\") " pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:26.737852 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.737680 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c722f10a-fb45-4208-ab19-9f28adf7e421-sys\") pod \"perf-node-gather-daemonset-md4g6\" (UID: \"c722f10a-fb45-4208-ab19-9f28adf7e421\") " pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:26.737852 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.737712 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c722f10a-fb45-4208-ab19-9f28adf7e421-proc\") pod \"perf-node-gather-daemonset-md4g6\" (UID: \"c722f10a-fb45-4208-ab19-9f28adf7e421\") " pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:26.737852 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.737758 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c722f10a-fb45-4208-ab19-9f28adf7e421-podres\") pod \"perf-node-gather-daemonset-md4g6\" (UID: \"c722f10a-fb45-4208-ab19-9f28adf7e421\") " pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:26.737852 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.737785 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c722f10a-fb45-4208-ab19-9f28adf7e421-proc\") pod \"perf-node-gather-daemonset-md4g6\" (UID: \"c722f10a-fb45-4208-ab19-9f28adf7e421\") " pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:26.737852 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.737759 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c722f10a-fb45-4208-ab19-9f28adf7e421-lib-modules\") pod \"perf-node-gather-daemonset-md4g6\" (UID: \"c722f10a-fb45-4208-ab19-9f28adf7e421\") " pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:26.737852 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.737785 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c722f10a-fb45-4208-ab19-9f28adf7e421-sys\") pod \"perf-node-gather-daemonset-md4g6\" (UID: \"c722f10a-fb45-4208-ab19-9f28adf7e421\") " pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:26.748272 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.748243 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw59d\" (UniqueName: \"kubernetes.io/projected/c722f10a-fb45-4208-ab19-9f28adf7e421-kube-api-access-zw59d\") pod \"perf-node-gather-daemonset-md4g6\" (UID: \"c722f10a-fb45-4208-ab19-9f28adf7e421\") " pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:26.897335 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:26.897051 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:27.071984 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:27.071772 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6"] Jul 06 21:01:27.075861 ip-10-0-142-58 kubenswrapper[2586]: W0706 21:01:27.075719 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc722f10a_fb45_4208_ab19_9f28adf7e421.slice/crio-daeb9df62e45a4df8b76fd02e1352b69385a9c7a9f2f7453c3ac447ad4751935 WatchSource:0}: Error finding container daeb9df62e45a4df8b76fd02e1352b69385a9c7a9f2f7453c3ac447ad4751935: Status 404 returned error can't find the container with id daeb9df62e45a4df8b76fd02e1352b69385a9c7a9f2f7453c3ac447ad4751935 Jul 06 21:01:27.461500 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:27.461030 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" event={"ID":"c722f10a-fb45-4208-ab19-9f28adf7e421","Type":"ContainerStarted","Data":"35de26a3c805f0e1950ffa340a2a5f832ff0e822aa973998c8aa45b6a2e55ed0"} Jul 06 21:01:27.461500 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:27.461113 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" event={"ID":"c722f10a-fb45-4208-ab19-9f28adf7e421","Type":"ContainerStarted","Data":"daeb9df62e45a4df8b76fd02e1352b69385a9c7a9f2f7453c3ac447ad4751935"} Jul 06 21:01:27.461500 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:27.461152 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:27.482245 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:27.482184 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" podStartSLOduration=1.482160494 podStartE2EDuration="1.482160494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:01:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:01:27.48009436 +0000 UTC m=+768.813910872" watchObservedRunningTime="2026-07-06 21:01:27.482160494 +0000 UTC m=+768.815977011" Jul 06 21:01:27.532478 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:27.532450 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dtxbd_5f9dfb85-aa70-4443-9923-09a46f9bdffb/dns/0.log" Jul 06 21:01:27.561523 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:27.561491 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dtxbd_5f9dfb85-aa70-4443-9923-09a46f9bdffb/kube-rbac-proxy/0.log" Jul 06 21:01:27.763147 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:27.763056 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pzt4k_37f92bd2-9e2e-4f5a-b8fd-c4291f3b9381/dns-node-resolver/0.log" Jul 06 21:01:28.340378 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:28.340345 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2d92l_67b2b0d4-1e54-408e-ae39-a626171fd87c/node-ca/0.log" Jul 06 21:01:29.767476 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:29.767445 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xg26k_13f352df-013d-46cf-9b1e-ef80acc6b127/serve-healthcheck-canary/0.log" Jul 06 21:01:30.439688 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:30.439651 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jxl99_a5d5ca02-9487-4300-9272-dce7514c8492/kube-rbac-proxy/0.log" Jul 06 21:01:30.468608 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:30.468574 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jxl99_a5d5ca02-9487-4300-9272-dce7514c8492/exporter/0.log" Jul 06 21:01:30.497208 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:30.497177 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jxl99_a5d5ca02-9487-4300-9272-dce7514c8492/extractor/0.log" Jul 06 21:01:32.887832 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:32.887800 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-jkbpl_7fc3f4c0-0b73-4494-87e0-cf32d0179983/manager/0.log" Jul 06 21:01:32.934254 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:32.934219 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-tffdz_b8c094cb-d3be-4c2a-b095-c485a49ad1dd/s3-init/0.log" Jul 06 21:01:32.961681 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:32.961646 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-tffdz_b8c094cb-d3be-4c2a-b095-c485a49ad1dd/download-hf-model/0.log" Jul 06 21:01:33.001639 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:33.001606 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-bcq9n_f18d575b-9263-4276-b447-856cdc91d5cb/s3-tls-init-custom/0.log" Jul 06 21:01:33.022118 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:33.022088 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-bcq9n_f18d575b-9263-4276-b447-856cdc91d5cb/download-hf-model/0.log" Jul 06 21:01:33.062817 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:33.062785 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-4vhpw_3ffc46d1-76a2-4e72-991d-15f8469ea91c/s3-tls-init-serving/0.log" Jul 06 21:01:33.084475 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:33.084443 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-4vhpw_3ffc46d1-76a2-4e72-991d-15f8469ea91c/download-hf-model/0.log" Jul 06 21:01:33.476670 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:33.476641 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rxdn5/perf-node-gather-daemonset-md4g6" Jul 06 21:01:38.426832 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:38.426798 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-n8v94_14e83e77-682c-4ed5-b8d9-d4bc425c5b26/kube-storage-version-migrator-operator/1.log" Jul 06 21:01:38.427934 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:38.427907 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-n8v94_14e83e77-682c-4ed5-b8d9-d4bc425c5b26/kube-storage-version-migrator-operator/0.log" Jul 06 21:01:40.288203 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:40.288172 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwzh6_305a40cd-a1ac-4b06-aa5f-c09c29459213/kube-multus-additional-cni-plugins/0.log" Jul 06 21:01:40.327776 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:40.327745 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwzh6_305a40cd-a1ac-4b06-aa5f-c09c29459213/egress-router-binary-copy/0.log" Jul 06 21:01:40.385145 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:40.385110 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwzh6_305a40cd-a1ac-4b06-aa5f-c09c29459213/cni-plugins/0.log" Jul 06 21:01:40.417750 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:40.417714 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwzh6_305a40cd-a1ac-4b06-aa5f-c09c29459213/bond-cni-plugin/0.log" Jul 06 21:01:40.464578 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:40.464547 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwzh6_305a40cd-a1ac-4b06-aa5f-c09c29459213/routeoverride-cni/0.log" Jul 06 21:01:40.501677 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:40.501643 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwzh6_305a40cd-a1ac-4b06-aa5f-c09c29459213/whereabouts-cni-bincopy/0.log" Jul 06 21:01:40.543531 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:40.543457 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nwzh6_305a40cd-a1ac-4b06-aa5f-c09c29459213/whereabouts-cni/0.log" Jul 06 21:01:40.604403 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:40.604372 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rkktm_15d6af7f-a295-4b83-8a7e-71280841ca8a/kube-multus/0.log" Jul 06 21:01:40.758316 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:40.758280 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f7qm4_014fb632-7183-4ad8-a74e-838a8d162eef/network-metrics-daemon/0.log" Jul 06 21:01:40.780720 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:40.780679 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f7qm4_014fb632-7183-4ad8-a74e-838a8d162eef/kube-rbac-proxy/0.log" Jul 06 21:01:41.899338 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:41.899309 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gl8x4_d32abe9d-5c42-41b8-aacf-0fdd0cf34c18/ovn-controller/0.log" Jul 06 21:01:41.927203 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:41.927176 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gl8x4_d32abe9d-5c42-41b8-aacf-0fdd0cf34c18/ovn-acl-logging/0.log" Jul 06 21:01:41.957756 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:41.957720 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gl8x4_d32abe9d-5c42-41b8-aacf-0fdd0cf34c18/kube-rbac-proxy-node/0.log" Jul 06 21:01:41.984020 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:41.983987 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gl8x4_d32abe9d-5c42-41b8-aacf-0fdd0cf34c18/kube-rbac-proxy-ovn-metrics/0.log" Jul 06 21:01:42.009776 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:42.009745 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gl8x4_d32abe9d-5c42-41b8-aacf-0fdd0cf34c18/northd/0.log" Jul 06 21:01:42.033950 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:42.033922 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gl8x4_d32abe9d-5c42-41b8-aacf-0fdd0cf34c18/nbdb/0.log" Jul 06 21:01:42.059828 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:42.059800 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gl8x4_d32abe9d-5c42-41b8-aacf-0fdd0cf34c18/sbdb/0.log" Jul 06 21:01:42.122804 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:42.122758 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gl8x4_d32abe9d-5c42-41b8-aacf-0fdd0cf34c18/ovnkube-controller/0.log" Jul 06 21:01:43.653011 ip-10-0-142-58 kubenswrapper[2586]: I0706 21:01:43.652972 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-rp2sj_a2ec5721-43da-420a-979e-8d87ce647c73/network-check-target-container/0.log"