Jul 28 16:33:44.135129 ip-10-0-140-117 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 28 16:33:44.135141 ip-10-0-140-117 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 28 16:33:44.135148 ip-10-0-140-117 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 28 16:33:44.135415 ip-10-0-140-117 systemd[1]: Failed to start Kubernetes Kubelet. Jul 28 16:33:54.384282 ip-10-0-140-117 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 28 16:33:54.384304 ip-10-0-140-117 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ccc94b1654f045b6ab9a7897045876cb -- Jul 28 16:35:52.537519 ip-10-0-140-117 systemd[1]: Starting Kubernetes Kubelet... Jul 28 16:35:52.900465 ip-10-0-140-117 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 16:35:52.900465 ip-10-0-140-117 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 16:35:52.900465 ip-10-0-140-117 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 16:35:52.900465 ip-10-0-140-117 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 16:35:52.900465 ip-10-0-140-117 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 16:35:52.901718 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.901627 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 16:35:52.905803 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905786 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:35:52.905803 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905802 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905806 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905810 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905813 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905815 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905818 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905821 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905824 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905827 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905829 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905832 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905834 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905837 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905839 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905842 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905846 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905850 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905854 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905857 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:35:52.905870 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905860 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905863 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905868 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905871 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905874 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905878 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905881 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905884 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905887 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905890 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905893 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905896 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905898 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905901 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905904 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905906 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905909 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905911 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905914 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:35:52.906383 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905917 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905919 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905922 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905925 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905929 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905933 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905936 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905939 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905942 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905944 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905947 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905949 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905952 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905955 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905957 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905961 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905964 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905966 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905969 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905971 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:35:52.906837 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905974 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905977 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905979 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905982 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905985 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905988 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905990 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905993 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905995 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.905998 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906001 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906004 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906006 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906009 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906011 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906014 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906017 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906019 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906021 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906024 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:35:52.907342 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906026 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906029 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906032 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906034 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906036 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906039 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906041 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906046 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906049 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906052 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906055 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906057 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906060 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906063 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906065 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906068 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906071 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906073 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906076 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:35:52.907826 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906078 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906802 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906810 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906813 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906817 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906820 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906823 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906826 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906829 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906832 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906834 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906837 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906840 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906843 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906845 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906848 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906851 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906853 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906856 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:35:52.908295 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906859 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906862 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906865 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906868 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906870 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906873 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906875 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906878 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906881 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906883 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906886 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906888 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906891 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906893 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906896 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906899 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906901 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906904 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906906 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:35:52.908767 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906909 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906911 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906914 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906916 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906919 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906922 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906924 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906928 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906931 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906934 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906937 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906940 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906943 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906946 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906949 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906952 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906954 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906957 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906960 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906962 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:35:52.909249 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906965 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906967 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906970 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906973 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906976 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906978 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906981 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906983 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906987 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906989 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906992 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906994 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906997 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.906999 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907002 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907005 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907009 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907012 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907015 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907017 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:35:52.909760 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907020 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907023 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907026 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907028 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907031 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907033 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907037 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907040 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907043 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907045 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907048 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907051 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907054 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907056 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907060 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907063 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907066 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907069 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907072 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907074 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:35:52.910260 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907077 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907080 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907468 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907473 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907477 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907479 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907483 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907485 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907488 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907491 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907493 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907496 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907499 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907502 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907505 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907508 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907510 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907513 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907515 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907518 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:35:52.910745 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907521 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907523 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907526 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907529 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907531 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907534 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907536 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907539 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907542 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907544 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907547 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907549 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907552 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907555 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907557 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907560 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907564 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907568 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907571 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:35:52.911303 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907573 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907576 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907578 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907581 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907586 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907589 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907592 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907595 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907598 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907601 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907604 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907607 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907610 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907613 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907616 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907618 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907621 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907623 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907626 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:35:52.911899 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907629 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907632 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907635 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907638 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907641 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907644 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907646 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907649 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907652 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907654 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907658 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907661 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907663 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907666 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907669 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907671 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907673 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907676 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907678 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907681 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:35:52.912382 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907684 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907686 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907688 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907691 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907694 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907696 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907699 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907701 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907704 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907706 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907709 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907712 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907714 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907717 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907719 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907722 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907724 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907726 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907729 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907732 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:35:52.912907 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907734 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907737 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.907740 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907800 2570 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907806 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907812 2570 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907816 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907820 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907824 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907828 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907833 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907837 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907840 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907844 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907848 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907851 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907854 2570 flags.go:64] FLAG: --cgroup-root="" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907857 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907860 2570 flags.go:64] FLAG: --client-ca-file="" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907863 2570 flags.go:64] FLAG: --cloud-provider="external" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907866 2570 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907870 2570 flags.go:64] FLAG: --cluster-domain="" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907873 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907878 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 16:35:52.913410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907881 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907885 2570 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907889 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907892 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907895 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907899 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907901 2570 flags.go:64] FLAG: --contention-profiling="false" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907905 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907908 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907911 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907914 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907918 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907921 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907925 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907927 2570 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907930 2570 flags.go:64] FLAG: --enable-server="true" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907934 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907938 2570 flags.go:64] FLAG: --event-burst="100" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907940 2570 flags.go:64] FLAG: --event-qps="50" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907944 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907947 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907949 2570 flags.go:64] FLAG: --eviction-hard="" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907953 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907956 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907959 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 16:35:52.913979 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907962 2570 flags.go:64] FLAG: --eviction-soft="" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907965 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907968 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907971 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907977 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907980 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907983 2570 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907986 2570 flags.go:64] FLAG: --feature-gates="" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907990 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907993 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907996 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.907999 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908002 2570 flags.go:64] FLAG: --healthz-port="10248" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908005 2570 flags.go:64] FLAG: --help="false" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908008 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-140-117.ec2.internal" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908011 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908014 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908016 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908020 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908023 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908026 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908029 2570 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908031 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 16:35:52.914609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908034 2570 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908037 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908041 2570 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908043 2570 flags.go:64] FLAG: --kube-reserved="" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908046 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908049 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908052 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908055 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908058 2570 flags.go:64] FLAG: --lock-file="" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908060 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908063 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908066 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908071 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908076 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908078 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908081 2570 flags.go:64] FLAG: --logging-format="text" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908084 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908087 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908090 2570 flags.go:64] FLAG: --manifest-url="" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908093 2570 flags.go:64] FLAG: --manifest-url-header="" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908097 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908100 2570 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908104 2570 flags.go:64] FLAG: --max-pods="110" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908107 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908110 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 16:35:52.915332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908113 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908115 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908119 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908121 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908124 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908131 2570 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908134 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908137 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908140 2570 flags.go:64] FLAG: --pod-cidr="" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908143 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908148 2570 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908151 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908155 2570 flags.go:64] FLAG: --pods-per-core="0" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908158 2570 flags.go:64] FLAG: --port="10250" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908161 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908164 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04a08689e9722f9c8" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908167 2570 flags.go:64] FLAG: --qos-reserved="" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908170 2570 flags.go:64] FLAG: --read-only-port="10255" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908173 2570 flags.go:64] FLAG: --register-node="true" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908176 2570 flags.go:64] FLAG: --register-with-taints="" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908182 2570 flags.go:64] FLAG: --registry-burst="10" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908185 2570 flags.go:64] FLAG: --registry-qps="5" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908188 2570 flags.go:64] FLAG: --reserved-cpus="" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908190 2570 flags.go:64] FLAG: --reserved-memory="" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908194 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 16:35:52.916251 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908201 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908204 2570 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908219 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908223 2570 flags.go:64] FLAG: --runonce="false" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908226 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908229 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908232 2570 flags.go:64] FLAG: --seccomp-default="false" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908235 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908239 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908242 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908245 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908248 2570 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908251 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908254 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908257 2570 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908259 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908262 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908265 2570 flags.go:64] FLAG: --system-cgroups="" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908268 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908274 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908276 2570 flags.go:64] FLAG: --tls-cert-file="" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908279 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908283 2570 flags.go:64] FLAG: --tls-min-version="" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908286 2570 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908288 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 16:35:52.917378 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908291 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908294 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908299 2570 flags.go:64] FLAG: --v="2" Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908304 2570 flags.go:64] FLAG: --version="false" Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908308 2570 flags.go:64] FLAG: --vmodule="" Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908312 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.908315 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908425 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908429 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908433 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908435 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908438 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908440 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908443 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908450 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908454 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908457 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908460 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908462 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908465 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908467 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:35:52.918455 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908470 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908473 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908475 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908478 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908480 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908483 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908486 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908488 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908491 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908493 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908496 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908498 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908501 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908505 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908507 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908510 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908513 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908515 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908518 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908520 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:35:52.919421 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908524 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908526 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908529 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908531 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908534 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908538 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908540 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908543 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908545 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908548 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908551 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908553 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908556 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908558 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908561 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908564 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908566 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908569 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908571 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908574 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:35:52.919972 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908576 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908579 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908581 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908584 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908586 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908590 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908593 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908595 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908598 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908600 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908603 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908605 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908608 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908619 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908622 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908625 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908628 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908632 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908636 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908638 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:35:52.920813 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908641 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908644 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908646 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908649 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908651 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908654 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908656 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908659 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908663 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908666 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908669 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908672 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908675 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908678 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908680 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908683 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908686 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908690 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908693 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:35:52.921607 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908696 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:35:52.922108 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908698 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:35:52.922108 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908701 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:35:52.922108 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908703 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:35:52.922108 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908707 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:35:52.922108 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.908711 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:35:52.922108 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.909228 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 16:35:52.922108 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.917956 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 16:35:52.922108 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.917976 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 16:35:52.922108 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.918003 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 16:35:52.922108 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.918013 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 16:35:52.922108 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918098 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:35:52.922108 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918106 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:35:52.922108 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918111 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:35:52.922108 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918116 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:35:52.922108 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918121 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918128 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918134 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918140 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918145 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918150 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918157 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918163 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918168 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918173 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918178 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918183 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918188 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918192 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918196 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918200 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918225 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918231 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918235 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:35:52.922594 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918240 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918244 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918248 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918253 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918257 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918261 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918267 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918272 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918276 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918281 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918285 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918289 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918294 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918298 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918302 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918306 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918310 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918315 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918319 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918323 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:35:52.923062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918327 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918332 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918336 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918342 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918347 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918351 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918355 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918359 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918364 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918367 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918372 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918376 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918381 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918385 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918389 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918396 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918402 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918407 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918411 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918416 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:35:52.923602 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918421 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918426 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918431 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918435 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918440 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918444 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918448 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918452 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918456 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918460 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918464 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918468 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918472 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918475 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918480 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918484 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918489 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918494 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918498 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918502 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:35:52.924092 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918507 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:35:52.924788 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918511 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:35:52.924788 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918515 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:35:52.924788 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918520 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:35:52.924788 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918524 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:35:52.924788 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918528 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:35:52.924788 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918533 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:35:52.924788 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918537 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:35:52.924788 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918541 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:35:52.924788 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918545 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:35:52.924788 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918550 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:35:52.924788 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918554 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:35:52.924788 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918559 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:35:52.924788 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918563 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:35:52.924788 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918567 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:35:52.924788 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918571 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:35:52.925182 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.918579 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 16:35:52.925182 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918786 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:35:52.925182 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918795 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:35:52.925182 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918801 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:35:52.925182 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918806 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:35:52.925182 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918810 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:35:52.925182 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918814 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:35:52.925182 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918821 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:35:52.925182 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918828 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:35:52.925182 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918833 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:35:52.925182 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918838 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:35:52.925182 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918842 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:35:52.925182 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918847 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:35:52.925182 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918857 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:35:52.925182 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918862 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918867 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918871 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918875 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918879 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918883 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918887 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918891 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918896 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918901 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918905 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918910 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918914 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918918 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918923 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918927 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918931 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918936 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918940 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918944 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:35:52.925576 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918948 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918953 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918957 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918961 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918965 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918970 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918974 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918978 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918982 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918986 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918991 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.918995 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919003 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919007 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919011 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919015 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919019 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919023 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919030 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:35:52.926126 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919035 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919041 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919046 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919050 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919055 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919060 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919064 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919068 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919073 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919077 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919082 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919086 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919090 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919094 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919099 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919104 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919108 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919112 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919116 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919120 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:35:52.926672 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919128 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919133 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919138 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919142 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919147 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919152 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919159 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919164 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919168 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919173 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919178 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919182 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919186 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919191 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919195 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919199 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919204 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919223 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919227 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919231 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:35:52.927155 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919235 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:35:52.927674 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919239 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:35:52.927674 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919242 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:35:52.927674 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919246 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:35:52.927674 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919250 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:35:52.927674 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919253 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:35:52.927674 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:52.919257 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:35:52.927674 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.919265 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 16:35:52.927674 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.919431 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 16:35:52.927674 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.922120 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 16:35:52.927674 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.925783 2570 server.go:1019] "Starting client certificate rotation" Jul 28 16:35:52.927674 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.925882 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 16:35:52.927674 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.926485 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 16:35:52.928861 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.928844 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 16:35:52.931713 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.931693 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 16:35:52.946191 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.946169 2570 log.go:25] "Validated CRI v1 runtime API" Jul 28 16:35:52.948376 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.948360 2570 log.go:25] "Validated CRI v1 image API" Jul 28 16:35:52.949348 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.949317 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 16:35:52.953400 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.953381 2570 fs.go:135] Filesystem UUIDs: map[068f64f4-abb8-4633-8bce-4636b73afdda:/dev/nvme0n1p3 2ec6918f-1919-4d6b-a767-3c0a0304cd99:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 28 16:35:52.953474 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.953400 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 16:35:52.953846 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.953829 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 16:35:52.961285 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.961161 2570 manager.go:216] Machine: {Timestamp:2026-07-28 16:35:52.959812249 +0000 UTC m=+0.319840820 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094514 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec279ba3bb5b82b1d72ddd4e8dcc0d11 SystemUUID:ec279ba3-bb5b-82b1-d72d-dd4e8dcc0d11 BootID:ccc94b16-54f0-45b6-ab9a-7897045876cb Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:20:68:5d:24:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:20:68:5d:24:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:26:8c:42:a7:87 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 16:35:52.961285 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.961273 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 16:35:52.961428 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.961402 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 16:35:52.964798 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.964765 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 16:35:52.964933 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.964801 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 16:35:52.965424 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.965414 2570 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 16:35:52.965460 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.965426 2570 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 16:35:52.965460 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.965434 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 16:35:52.965967 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.965957 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 16:35:52.966650 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.966640 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 16:35:52.968858 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.968846 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 28 16:35:52.968977 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.968968 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 16:35:52.969012 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.968999 2570 kubelet.go:486] "Attempting to sync node with API server" Jul 28 16:35:52.969012 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.969011 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 16:35:52.969072 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.969026 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 16:35:52.969072 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.969035 2570 kubelet.go:398] "Adding apiserver pod source" Jul 28 16:35:52.969072 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.969044 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 16:35:52.969455 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.969443 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 16:35:52.969512 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.969459 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 16:35:52.971621 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.971605 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 16:35:52.973476 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.973463 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 16:35:52.973518 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.973492 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 16:35:52.975065 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.975053 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 16:35:52.975108 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.975070 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 16:35:52.975108 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.975076 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 16:35:52.975108 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.975082 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 16:35:52.975108 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.975090 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 16:35:52.975108 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.975095 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 16:35:52.975108 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.975103 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 16:35:52.975108 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.975108 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 16:35:52.975301 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.975115 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 16:35:52.975301 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.975121 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 16:35:52.975301 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.975129 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 16:35:52.975301 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.975134 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 16:35:52.976355 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.976344 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 16:35:52.976386 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.976356 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 16:35:52.976460 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.976341 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m8tnf" Jul 28 16:35:52.979712 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.979699 2570 server.go:1268] "Started kubelet" Jul 28 16:35:52.979925 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.979831 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 16:35:52.979925 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.979913 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 16:35:52.980030 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.979978 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 16:35:52.980565 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.980545 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 16:35:52.980667 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:52.980644 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 16:35:52.980724 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:52.980684 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 16:35:52.980676 ip-10-0-140-117 systemd[1]: Started Kubernetes Kubelet. Jul 28 16:35:52.981873 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.981849 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 16:35:52.982791 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.982774 2570 server.go:310] "Adding debug handlers to kubelet server" Jul 28 16:35:52.985128 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.985108 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m8tnf" Jul 28 16:35:52.986248 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:52.985356 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-117.ec2.internal.18c68160514aa818 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-117.ec2.internal,UID:ip-10-0-140-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-117.ec2.internal,},FirstTimestamp:2026-07-28 16:35:52.979671064 +0000 UTC m=+0.339699635,LastTimestamp:2026-07-28 16:35:52.979671064 +0000 UTC m=+0.339699635,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-117.ec2.internal,}" Jul 28 16:35:52.986484 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:52.986469 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 16:35:52.990895 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.990874 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 16:35:52.990977 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.990907 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 16:35:52.991098 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:52.991075 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Jul 28 16:35:52.991718 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.991703 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 16:35:52.991718 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.991702 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 16:35:52.991874 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.991773 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 16:35:52.991874 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.991788 2570 factory.go:55] Registering systemd factory Jul 28 16:35:52.991874 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.991824 2570 factory.go:223] Registration of the systemd container factory successfully Jul 28 16:35:52.992017 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.991925 2570 reconstruct.go:97] "Volume reconstruction finished" Jul 28 16:35:52.992017 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.991934 2570 reconciler.go:29] "Reconciler: start to sync state" Jul 28 16:35:52.992256 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.992243 2570 factory.go:153] Registering CRI-O factory Jul 28 16:35:52.992395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.992333 2570 factory.go:223] Registration of the crio container factory successfully Jul 28 16:35:52.992551 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.992538 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 16:35:52.992639 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.992566 2570 factory.go:103] Registering Raw factory Jul 28 16:35:52.992639 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.992583 2570 manager.go:1196] Started watching for new ooms in manager Jul 28 16:35:52.993109 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.993088 2570 manager.go:349] Starting recovery of all containers Jul 28 16:35:52.993658 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:52.993635 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 16:35:52.997090 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:52.996836 2570 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-117.ec2.internal\" not found" node="ip-10-0-140-117.ec2.internal" Jul 28 16:35:53.006231 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.006198 2570 manager.go:354] Recovery completed Jul 28 16:35:53.010955 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.010942 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:35:53.012878 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.012859 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:35:53.012945 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.012893 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:35:53.012945 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.012906 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:35:53.013438 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.013422 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 16:35:53.013510 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.013438 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:35:53.013510 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.013437 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 16:35:53.013581 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.013511 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 28 16:35:53.014104 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.014090 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:35:53.014181 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.014115 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:35:53.014181 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.014129 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:35:53.015239 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.015227 2570 policy_none.go:49] "None policy: Start" Jul 28 16:35:53.015289 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.015243 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 16:35:53.015289 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.015254 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 16:35:53.016364 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.016353 2570 policy_none.go:47] "Start" Jul 28 16:35:53.047915 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.047781 2570 manager.go:337] "Starting Device Plugin manager" Jul 28 16:35:53.048009 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:53.047936 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 16:35:53.048009 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.047949 2570 server.go:87] "Starting device plugin registration server" Jul 28 16:35:53.048225 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.048195 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 16:35:53.048286 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.048226 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 16:35:53.048348 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.048300 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 16:35:53.048394 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.048382 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 16:35:53.048394 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:53.048392 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 16:35:53.048947 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:53.048927 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 16:35:53.049024 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:53.048981 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-117.ec2.internal\" not found" Jul 28 16:35:55.029171 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.029143 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:35:55.030159 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.030142 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:35:55.030226 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.030174 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:35:55.030226 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.030188 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:35:55.030226 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.030220 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-117.ec2.internal" Jul 28 16:35:55.036512 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.036465 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-117.ec2.internal" Jul 28 16:35:55.036512 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:55.036486 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-117.ec2.internal\": node \"ip-10-0-140-117.ec2.internal\" not found" Jul 28 16:35:55.045784 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.045757 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 16:35:55.047002 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.046979 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 16:35:55.047086 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.047033 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 16:35:55.047086 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.047058 2570 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 16:35:55.047179 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:55.047093 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 16:35:55.049726 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.049710 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 16:35:55.051531 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:55.051514 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Jul 28 16:35:55.147943 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.147908 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal"] Jul 28 16:35:55.148094 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.147987 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:35:55.149560 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.149543 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:35:55.149632 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.149575 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:35:55.149632 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.149585 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:35:55.150823 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.150809 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:35:55.150946 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.150932 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Jul 28 16:35:55.151006 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.150969 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:35:55.151517 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.151504 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:35:55.151580 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.151530 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:35:55.151580 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.151545 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:35:55.151580 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.151506 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:35:55.151726 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.151601 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:35:55.151726 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.151619 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:35:55.151726 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:55.151657 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Jul 28 16:35:55.152733 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.152718 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" Jul 28 16:35:55.152814 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.152745 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:35:55.153397 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.153384 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:35:55.153470 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.153411 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:35:55.153470 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.153425 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:35:55.174440 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.174416 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b7aeeb0f4b30a61ac591fd9bec51342-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal\" (UID: \"4b7aeeb0f4b30a61ac591fd9bec51342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Jul 28 16:35:55.174521 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.174442 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b7aeeb0f4b30a61ac591fd9bec51342-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal\" (UID: \"4b7aeeb0f4b30a61ac591fd9bec51342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Jul 28 16:35:55.174521 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.174460 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc19e62a3119df3b706b9f3232a5ea75-config\") pod \"kube-apiserver-proxy-ip-10-0-140-117.ec2.internal\" (UID: \"dc19e62a3119df3b706b9f3232a5ea75\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" Jul 28 16:35:55.185449 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:55.185427 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-117.ec2.internal\" not found" node="ip-10-0-140-117.ec2.internal" Jul 28 16:35:55.190005 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:55.189991 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-117.ec2.internal\" not found" node="ip-10-0-140-117.ec2.internal" Jul 28 16:35:55.252100 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:55.252075 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Jul 28 16:35:55.274920 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.274896 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b7aeeb0f4b30a61ac591fd9bec51342-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal\" (UID: \"4b7aeeb0f4b30a61ac591fd9bec51342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Jul 28 16:35:55.274988 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.274934 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b7aeeb0f4b30a61ac591fd9bec51342-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal\" (UID: \"4b7aeeb0f4b30a61ac591fd9bec51342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Jul 28 16:35:55.274988 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.274951 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc19e62a3119df3b706b9f3232a5ea75-config\") pod \"kube-apiserver-proxy-ip-10-0-140-117.ec2.internal\" (UID: \"dc19e62a3119df3b706b9f3232a5ea75\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" Jul 28 16:35:55.275049 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.274992 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b7aeeb0f4b30a61ac591fd9bec51342-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal\" (UID: \"4b7aeeb0f4b30a61ac591fd9bec51342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Jul 28 16:35:55.275049 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.275006 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc19e62a3119df3b706b9f3232a5ea75-config\") pod \"kube-apiserver-proxy-ip-10-0-140-117.ec2.internal\" (UID: \"dc19e62a3119df3b706b9f3232a5ea75\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" Jul 28 16:35:55.275049 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.275018 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b7aeeb0f4b30a61ac591fd9bec51342-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal\" (UID: \"4b7aeeb0f4b30a61ac591fd9bec51342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Jul 28 16:35:55.352328 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:55.352267 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Jul 28 16:35:55.452777 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:55.452735 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Jul 28 16:35:55.488278 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.488255 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Jul 28 16:35:55.493468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.493452 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" Jul 28 16:35:55.553478 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:55.553441 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Jul 28 16:35:55.653997 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:55.653924 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Jul 28 16:35:55.754494 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:55.754467 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Jul 28 16:35:55.806072 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.806052 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 16:35:55.806487 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.806214 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 16:35:55.806487 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.806240 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 16:35:55.855586 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:55.855548 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Jul 28 16:35:55.870052 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.870017 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 16:30:54 +0000 UTC" deadline="2028-02-09 19:40:06.749146026 +0000 UTC" Jul 28 16:35:55.870052 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.870047 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13467h4m10.879102725s" Jul 28 16:35:55.922003 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:55.921920 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 16:35:55.956008 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:55.955983 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Jul 28 16:35:56.056902 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:56.056881 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Jul 28 16:35:56.068199 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:56.068159 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b7aeeb0f4b30a61ac591fd9bec51342.slice/crio-1f3a4dc982775bacd4ad27d1c2b8029ee3f0d138635b5bcb9f6e441fc05d4dc3 WatchSource:0}: Error finding container 1f3a4dc982775bacd4ad27d1c2b8029ee3f0d138635b5bcb9f6e441fc05d4dc3: Status 404 returned error can't find the container with id 1f3a4dc982775bacd4ad27d1c2b8029ee3f0d138635b5bcb9f6e441fc05d4dc3 Jul 28 16:35:56.072601 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.072585 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 16:35:56.157188 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:56.157154 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Jul 28 16:35:56.257710 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:56.257601 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Jul 28 16:35:56.279646 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.279629 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 16:35:56.280588 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:56.280556 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc19e62a3119df3b706b9f3232a5ea75.slice/crio-61bd1136c3ade0af607d24eff5aebb6550257ad813aed28748d1fba1798f8a68 WatchSource:0}: Error finding container 61bd1136c3ade0af607d24eff5aebb6550257ad813aed28748d1fba1798f8a68: Status 404 returned error can't find the container with id 61bd1136c3ade0af607d24eff5aebb6550257ad813aed28748d1fba1798f8a68 Jul 28 16:35:56.372490 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.372464 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" Jul 28 16:35:56.382586 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.382564 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 16:35:56.383578 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.383566 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Jul 28 16:35:56.396506 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.396481 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 16:35:56.851372 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.851329 2570 apiserver.go:52] "Watching apiserver" Jul 28 16:35:56.858444 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.858099 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 16:35:56.859944 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.859919 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-bv6hj","openshift-dns/node-resolver-4ztpj","openshift-image-registry/node-ca-2bvtp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal","openshift-multus/multus-additional-cni-plugins-77cw2","kube-system/global-pull-secret-syncer-qfctx","openshift-multus/multus-zqc4q","openshift-multus/network-metrics-daemon-rk2lg","openshift-network-diagnostics/network-check-target-ghkxh","openshift-network-operator/iptables-alerter-cnxsw","openshift-ovn-kubernetes/ovnkube-node-5rc9g","kube-system/konnectivity-agent-tv4dg","kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr"] Jul 28 16:35:56.861518 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.861498 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cnxsw" Jul 28 16:35:56.863003 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.862975 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.864176 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.864152 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2bvtp" Jul 28 16:35:56.864273 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.864186 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 16:35:56.864424 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.864400 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 16:35:56.864845 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.864668 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 16:35:56.864845 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.864673 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s5n8d\"" Jul 28 16:35:56.865471 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.865250 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.866110 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.866088 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-42dfw\"" Jul 28 16:35:56.866347 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.866332 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 16:35:56.867222 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.866658 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.867222 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.867068 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 16:35:56.867222 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.867103 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 16:35:56.867437 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.867302 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 16:35:56.867437 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.867357 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gvz5b\"" Jul 28 16:35:56.867437 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.867414 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 16:35:56.867437 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.867429 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 16:35:56.867628 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.867483 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 16:35:56.867628 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.867594 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 16:35:56.867950 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.867752 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 16:35:56.867950 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.867844 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 16:35:56.867950 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.867925 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qkq46\"" Jul 28 16:35:56.868135 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.868044 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 16:35:56.868406 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.868290 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 16:35:56.870112 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.868889 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 16:35:56.870112 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.869356 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 16:35:56.870112 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.869428 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:35:56.870112 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:56.869505 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfctx" podUID="c8b7d602-7f06-4c32-85e7-fd711dcf48ef" Jul 28 16:35:56.870112 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.869845 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 16:35:56.870112 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.869926 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s7864\"" Jul 28 16:35:56.870438 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.870130 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 16:35:56.870438 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.870130 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 16:35:56.871059 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.870961 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:35:56.871059 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:56.871020 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghkxh" podUID="a34f5490-8d32-4aba-808d-5d9a2b0b65e6" Jul 28 16:35:56.872368 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.872348 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 16:35:56.873522 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.873502 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:35:56.873614 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:56.873582 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk2lg" podUID="43046d78-bb7a-40ab-9e3e-d2d901471738" Jul 28 16:35:56.876005 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.875986 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4ztpj" Jul 28 16:35:56.878289 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.878267 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 16:35:56.878597 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.878578 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v8tb2\"" Jul 28 16:35:56.878798 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.878779 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 16:35:56.879898 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.879878 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:56.881600 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.881577 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.882340 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.882317 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 16:35:56.882496 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.882331 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 16:35:56.883383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.882740 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tv4dg" Jul 28 16:35:56.883383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883083 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c4739766-1cfe-4c32-b9a5-80b39d7ca485-ovnkube-config\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.883383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883105 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/161c4091-677f-4218-8594-cbe3d29004c7-os-release\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.883383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883162 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/161c4091-677f-4218-8594-cbe3d29004c7-cni-binary-copy\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.883383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883180 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/60740267-062b-483e-a3d6-c15cac4a5d70-iptables-alerter-script\") pod \"iptables-alerter-cnxsw\" (UID: \"60740267-062b-483e-a3d6-c15cac4a5d70\") " pod="openshift-network-operator/iptables-alerter-cnxsw" Jul 28 16:35:56.883383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883195 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dvlk\" (UniqueName: \"kubernetes.io/projected/750f3037-9908-4415-9550-90fc8f863882-kube-api-access-9dvlk\") pod \"node-resolver-4ztpj\" (UID: \"750f3037-9908-4415-9550-90fc8f863882\") " pod="openshift-dns/node-resolver-4ztpj" Jul 28 16:35:56.883383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883211 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-registration-dir\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.883383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883227 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rn4q\" (UniqueName: \"kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q\") pod \"network-check-target-ghkxh\" (UID: \"a34f5490-8d32-4aba-808d-5d9a2b0b65e6\") " pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:35:56.883383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883242 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd2jq\" (UniqueName: \"kubernetes.io/projected/60740267-062b-483e-a3d6-c15cac4a5d70-kube-api-access-xd2jq\") pod \"iptables-alerter-cnxsw\" (UID: \"60740267-062b-483e-a3d6-c15cac4a5d70\") " pod="openshift-network-operator/iptables-alerter-cnxsw" Jul 28 16:35:56.883383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883257 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs\") pod \"network-metrics-daemon-rk2lg\" (UID: \"43046d78-bb7a-40ab-9e3e-d2d901471738\") " pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:35:56.883383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883271 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-etc-openvswitch\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.883383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883285 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-cni-bin\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.883383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883299 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.883383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883313 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-sys-fs\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.883383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883327 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99b4a0dc-9c95-4215-8c0c-2e18b9442836-host\") pod \"node-ca-2bvtp\" (UID: \"99b4a0dc-9c95-4215-8c0c-2e18b9442836\") " pod="openshift-image-registry/node-ca-2bvtp" Jul 28 16:35:56.883383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883375 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d47bv\"" Jul 28 16:35:56.884395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883522 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-node-log\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.884395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883556 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c4739766-1cfe-4c32-b9a5-80b39d7ca485-ovnkube-script-lib\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.884395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883593 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w6dj\" (UniqueName: \"kubernetes.io/projected/c4739766-1cfe-4c32-b9a5-80b39d7ca485-kube-api-access-2w6dj\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.884395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883621 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/161c4091-677f-4218-8594-cbe3d29004c7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.884395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883659 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60740267-062b-483e-a3d6-c15cac4a5d70-host-slash\") pod \"iptables-alerter-cnxsw\" (UID: \"60740267-062b-483e-a3d6-c15cac4a5d70\") " pod="openshift-network-operator/iptables-alerter-cnxsw" Jul 28 16:35:56.884395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883683 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5h57\" (UniqueName: \"kubernetes.io/projected/99b4a0dc-9c95-4215-8c0c-2e18b9442836-kube-api-access-q5h57\") pod \"node-ca-2bvtp\" (UID: \"99b4a0dc-9c95-4215-8c0c-2e18b9442836\") " pod="openshift-image-registry/node-ca-2bvtp" Jul 28 16:35:56.884395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883871 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/750f3037-9908-4415-9550-90fc8f863882-tmp-dir\") pod \"node-resolver-4ztpj\" (UID: \"750f3037-9908-4415-9550-90fc8f863882\") " pod="openshift-dns/node-resolver-4ztpj" Jul 28 16:35:56.884395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883894 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-kubelet\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.884395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883916 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.884395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883939 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr9s4\" (UniqueName: \"kubernetes.io/projected/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-kube-api-access-pr9s4\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.884395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883962 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/161c4091-677f-4218-8594-cbe3d29004c7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.884395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.883990 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn8pr\" (UniqueName: \"kubernetes.io/projected/161c4091-677f-4218-8594-cbe3d29004c7-kube-api-access-jn8pr\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.884395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884016 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt58z\" (UniqueName: \"kubernetes.io/projected/43046d78-bb7a-40ab-9e3e-d2d901471738-kube-api-access-wt58z\") pod \"network-metrics-daemon-rk2lg\" (UID: \"43046d78-bb7a-40ab-9e3e-d2d901471738\") " pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:35:56.884395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884041 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/750f3037-9908-4415-9550-90fc8f863882-hosts-file\") pod \"node-resolver-4ztpj\" (UID: \"750f3037-9908-4415-9550-90fc8f863882\") " pod="openshift-dns/node-resolver-4ztpj" Jul 28 16:35:56.884395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884064 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-run-netns\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.884395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884088 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-run-systemd\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.885165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884108 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-cni-netd\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.885165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884129 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-socket-dir\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.885165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884153 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/161c4091-677f-4218-8594-cbe3d29004c7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.885165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884178 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/99b4a0dc-9c95-4215-8c0c-2e18b9442836-serviceca\") pod \"node-ca-2bvtp\" (UID: \"99b4a0dc-9c95-4215-8c0c-2e18b9442836\") " pod="openshift-image-registry/node-ca-2bvtp" Jul 28 16:35:56.885165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884204 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-kubelet-config\") pod \"global-pull-secret-syncer-qfctx\" (UID: \"c8b7d602-7f06-4c32-85e7-fd711dcf48ef\") " pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:35:56.885165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884237 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-run-openvswitch\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.885165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884260 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-run-ovn-kubernetes\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.885165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884284 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4739766-1cfe-4c32-b9a5-80b39d7ca485-ovn-node-metrics-cert\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.885165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884316 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-device-dir\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.885165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884339 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-dbus\") pod \"global-pull-secret-syncer-qfctx\" (UID: \"c8b7d602-7f06-4c32-85e7-fd711dcf48ef\") " pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:35:56.885165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884368 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 16:35:56.885165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884375 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret\") pod \"global-pull-secret-syncer-qfctx\" (UID: \"c8b7d602-7f06-4c32-85e7-fd711dcf48ef\") " pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:35:56.885165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884398 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-log-socket\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.885165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884421 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-systemd-units\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.885165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884446 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-slash\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.885165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884469 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-var-lib-openvswitch\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.885165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884492 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c4739766-1cfe-4c32-b9a5-80b39d7ca485-env-overrides\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.886186 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884515 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-etc-selinux\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.886186 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884550 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-klwnh\"" Jul 28 16:35:56.886186 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884545 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/161c4091-677f-4218-8594-cbe3d29004c7-system-cni-dir\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.886186 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884584 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/161c4091-677f-4218-8594-cbe3d29004c7-cnibin\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.886186 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.884608 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-run-ovn\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.886186 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.885107 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 16:35:56.886186 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.885151 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 16:35:56.886186 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.885158 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p65wl\"" Jul 28 16:35:56.886186 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.885383 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 16:35:56.916106 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.916081 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4jwr4" Jul 28 16:35:56.922275 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.922252 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4jwr4" Jul 28 16:35:56.933140 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.933120 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 16:35:56.973526 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.973495 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 16:35:56.985371 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985340 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-sysconfig\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:56.985371 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985379 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blg9c\" (UniqueName: \"kubernetes.io/projected/f91f1f9b-2162-4684-93c6-ade306fa6522-kube-api-access-blg9c\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:56.985584 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985408 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9g5j\" (UniqueName: \"kubernetes.io/projected/8256e603-8e9d-41ad-b9cc-784338dddcf0-kube-api-access-t9g5j\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.985584 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985435 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-systemd-units\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.985584 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985453 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-etc-selinux\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.985584 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985487 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/161c4091-677f-4218-8594-cbe3d29004c7-cnibin\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.985584 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985514 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/161c4091-677f-4218-8594-cbe3d29004c7-cni-binary-copy\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.985584 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985528 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-systemd-units\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.985584 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985536 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/60740267-062b-483e-a3d6-c15cac4a5d70-iptables-alerter-script\") pod \"iptables-alerter-cnxsw\" (UID: \"60740267-062b-483e-a3d6-c15cac4a5d70\") " pod="openshift-network-operator/iptables-alerter-cnxsw" Jul 28 16:35:56.985584 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985573 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-kubernetes\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:56.985997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985586 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/161c4091-677f-4218-8594-cbe3d29004c7-cnibin\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.985997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985596 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8256e603-8e9d-41ad-b9cc-784338dddcf0-cni-binary-copy\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.985997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985620 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-run-k8s-cni-cncf-io\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.985997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985645 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/161c4091-677f-4218-8594-cbe3d29004c7-os-release\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.985997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985621 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-etc-selinux\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.985997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985669 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvlk\" (UniqueName: \"kubernetes.io/projected/750f3037-9908-4415-9550-90fc8f863882-kube-api-access-9dvlk\") pod \"node-resolver-4ztpj\" (UID: \"750f3037-9908-4415-9550-90fc8f863882\") " pod="openshift-dns/node-resolver-4ztpj" Jul 28 16:35:56.985997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985707 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-var-lib-cni-multus\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.985997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985740 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-var-lib-kubelet\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.985997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985769 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/161c4091-677f-4218-8594-cbe3d29004c7-os-release\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.985997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985772 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rn4q\" (UniqueName: \"kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q\") pod \"network-check-target-ghkxh\" (UID: \"a34f5490-8d32-4aba-808d-5d9a2b0b65e6\") " pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:35:56.985997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985803 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd2jq\" (UniqueName: \"kubernetes.io/projected/60740267-062b-483e-a3d6-c15cac4a5d70-kube-api-access-xd2jq\") pod \"iptables-alerter-cnxsw\" (UID: \"60740267-062b-483e-a3d6-c15cac4a5d70\") " pod="openshift-network-operator/iptables-alerter-cnxsw" Jul 28 16:35:56.985997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985828 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-var-lib-cni-bin\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.985997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985854 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-cni-bin\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.985997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985902 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c4739766-1cfe-4c32-b9a5-80b39d7ca485-ovnkube-script-lib\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.985997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985926 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/161c4091-677f-4218-8594-cbe3d29004c7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.985997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985950 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60740267-062b-483e-a3d6-c15cac4a5d70-host-slash\") pod \"iptables-alerter-cnxsw\" (UID: \"60740267-062b-483e-a3d6-c15cac4a5d70\") " pod="openshift-network-operator/iptables-alerter-cnxsw" Jul 28 16:35:56.985997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985972 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91f1f9b-2162-4684-93c6-ade306fa6522-tmp\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:56.986862 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.985998 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-hostroot\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.986862 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986022 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3764a6ab-bd08-4d46-a39a-0b491e8e08d6-agent-certs\") pod \"konnectivity-agent-tv4dg\" (UID: \"3764a6ab-bd08-4d46-a39a-0b491e8e08d6\") " pod="kube-system/konnectivity-agent-tv4dg" Jul 28 16:35:56.986862 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986072 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/60740267-062b-483e-a3d6-c15cac4a5d70-iptables-alerter-script\") pod \"iptables-alerter-cnxsw\" (UID: \"60740267-062b-483e-a3d6-c15cac4a5d70\") " pod="openshift-network-operator/iptables-alerter-cnxsw" Jul 28 16:35:56.986862 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986216 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/161c4091-677f-4218-8594-cbe3d29004c7-cni-binary-copy\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.986862 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986235 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-kubelet\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.986862 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986265 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.986862 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986290 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr9s4\" (UniqueName: \"kubernetes.io/projected/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-kube-api-access-pr9s4\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.986862 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986315 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn8pr\" (UniqueName: \"kubernetes.io/projected/161c4091-677f-4218-8594-cbe3d29004c7-kube-api-access-jn8pr\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.986862 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986357 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/161c4091-677f-4218-8594-cbe3d29004c7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.986862 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986379 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt58z\" (UniqueName: \"kubernetes.io/projected/43046d78-bb7a-40ab-9e3e-d2d901471738-kube-api-access-wt58z\") pod \"network-metrics-daemon-rk2lg\" (UID: \"43046d78-bb7a-40ab-9e3e-d2d901471738\") " pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:35:56.986862 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986400 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-kubelet\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.986862 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986408 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-var-lib-kubelet\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:56.986862 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986435 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-multus-cni-dir\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.986862 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986453 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-run-systemd\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.986862 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986468 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-cni-netd\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.986862 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986483 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-socket-dir\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.986862 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986530 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/99b4a0dc-9c95-4215-8c0c-2e18b9442836-serviceca\") pod \"node-ca-2bvtp\" (UID: \"99b4a0dc-9c95-4215-8c0c-2e18b9442836\") " pod="openshift-image-registry/node-ca-2bvtp" Jul 28 16:35:56.987780 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986555 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-kubelet-config\") pod \"global-pull-secret-syncer-qfctx\" (UID: \"c8b7d602-7f06-4c32-85e7-fd711dcf48ef\") " pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:35:56.987780 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986579 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret\") pod \"global-pull-secret-syncer-qfctx\" (UID: \"c8b7d602-7f06-4c32-85e7-fd711dcf48ef\") " pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:35:56.987780 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986599 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c4739766-1cfe-4c32-b9a5-80b39d7ca485-ovnkube-script-lib\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.987780 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986607 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-sysctl-d\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:56.987780 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986625 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-etc-kubernetes\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.987780 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986632 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60740267-062b-483e-a3d6-c15cac4a5d70-host-slash\") pod \"iptables-alerter-cnxsw\" (UID: \"60740267-062b-483e-a3d6-c15cac4a5d70\") " pod="openshift-network-operator/iptables-alerter-cnxsw" Jul 28 16:35:56.987780 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986644 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-run-ovn-kubernetes\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.987780 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986651 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-cni-bin\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.987780 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986660 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-device-dir\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.987780 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986726 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-run-systemd\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.987780 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986760 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-log-socket\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.987780 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986804 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-slash\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.987780 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986842 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-var-lib-openvswitch\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.987780 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986871 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c4739766-1cfe-4c32-b9a5-80b39d7ca485-env-overrides\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.987780 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986895 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/161c4091-677f-4218-8594-cbe3d29004c7-system-cni-dir\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.987780 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986927 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-modprobe-d\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:56.987780 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986930 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-device-dir\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986953 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-run\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:56.986981 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.986992 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-run-ovn-kubernetes\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987009 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-system-cni-dir\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987032 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-log-socket\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987039 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-run-ovn\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987032 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-kubelet-config\") pod \"global-pull-secret-syncer-qfctx\" (UID: \"c8b7d602-7f06-4c32-85e7-fd711dcf48ef\") " pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987056 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c4739766-1cfe-4c32-b9a5-80b39d7ca485-ovnkube-config\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987088 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-run-netns\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987104 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3764a6ab-bd08-4d46-a39a-0b491e8e08d6-konnectivity-ca\") pod \"konnectivity-agent-tv4dg\" (UID: \"3764a6ab-bd08-4d46-a39a-0b491e8e08d6\") " pod="kube-system/konnectivity-agent-tv4dg" Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987121 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-registration-dir\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987121 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987086 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-cni-netd\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987165 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs\") pod \"network-metrics-daemon-rk2lg\" (UID: \"43046d78-bb7a-40ab-9e3e-d2d901471738\") " pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987182 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-sysctl-conf\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987184 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-run-ovn\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987196 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-lib-modules\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:56.988635 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987210 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-host\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:56.989468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987225 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-run-multus-certs\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.989468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987240 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-etc-openvswitch\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.989468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987258 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.989468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987279 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-sys-fs\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.989468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987294 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99b4a0dc-9c95-4215-8c0c-2e18b9442836-host\") pod \"node-ca-2bvtp\" (UID: \"99b4a0dc-9c95-4215-8c0c-2e18b9442836\") " pod="openshift-image-registry/node-ca-2bvtp" Jul 28 16:35:56.989468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987344 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-systemd\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:56.989468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987358 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-cnibin\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.989468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987373 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-os-release\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.989468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987388 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-node-log\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.989468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987395 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-registration-dir\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.989468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987398 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c4739766-1cfe-4c32-b9a5-80b39d7ca485-env-overrides\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.989468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987432 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99b4a0dc-9c95-4215-8c0c-2e18b9442836-host\") pod \"node-ca-2bvtp\" (UID: \"99b4a0dc-9c95-4215-8c0c-2e18b9442836\") " pod="openshift-image-registry/node-ca-2bvtp" Jul 28 16:35:56.989468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987597 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-slash\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.989468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987403 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w6dj\" (UniqueName: \"kubernetes.io/projected/c4739766-1cfe-4c32-b9a5-80b39d7ca485-kube-api-access-2w6dj\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.989468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987638 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5h57\" (UniqueName: \"kubernetes.io/projected/99b4a0dc-9c95-4215-8c0c-2e18b9442836-kube-api-access-q5h57\") pod \"node-ca-2bvtp\" (UID: \"99b4a0dc-9c95-4215-8c0c-2e18b9442836\") " pod="openshift-image-registry/node-ca-2bvtp" Jul 28 16:35:56.989468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987666 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/750f3037-9908-4415-9550-90fc8f863882-tmp-dir\") pod \"node-resolver-4ztpj\" (UID: \"750f3037-9908-4415-9550-90fc8f863882\") " pod="openshift-dns/node-resolver-4ztpj" Jul 28 16:35:56.989468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987712 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-tuned\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:56.990304 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987741 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/161c4091-677f-4218-8594-cbe3d29004c7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.990304 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987774 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/99b4a0dc-9c95-4215-8c0c-2e18b9442836-serviceca\") pod \"node-ca-2bvtp\" (UID: \"99b4a0dc-9c95-4215-8c0c-2e18b9442836\") " pod="openshift-image-registry/node-ca-2bvtp" Jul 28 16:35:56.990304 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987801 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/750f3037-9908-4415-9550-90fc8f863882-hosts-file\") pod \"node-resolver-4ztpj\" (UID: \"750f3037-9908-4415-9550-90fc8f863882\") " pod="openshift-dns/node-resolver-4ztpj" Jul 28 16:35:56.990304 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987828 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-sys\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:56.990304 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987830 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-var-lib-openvswitch\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.990304 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987844 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c4739766-1cfe-4c32-b9a5-80b39d7ca485-ovnkube-config\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.990304 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.987901 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/750f3037-9908-4415-9550-90fc8f863882-hosts-file\") pod \"node-resolver-4ztpj\" (UID: \"750f3037-9908-4415-9550-90fc8f863882\") " pod="openshift-dns/node-resolver-4ztpj" Jul 28 16:35:56.990304 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988089 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/750f3037-9908-4415-9550-90fc8f863882-tmp-dir\") pod \"node-resolver-4ztpj\" (UID: \"750f3037-9908-4415-9550-90fc8f863882\") " pod="openshift-dns/node-resolver-4ztpj" Jul 28 16:35:56.990304 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988131 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-etc-openvswitch\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.990304 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988187 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.990304 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988190 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-node-log\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.990304 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988229 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/161c4091-677f-4218-8594-cbe3d29004c7-system-cni-dir\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.990304 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:56.988313 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:35:56.990304 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:56.988367 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret podName:c8b7d602-7f06-4c32-85e7-fd711dcf48ef nodeName:}" failed. No retries permitted until 2026-07-28 16:35:57.487899566 +0000 UTC m=+2.967448141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret") pod "global-pull-secret-syncer-qfctx" (UID: "c8b7d602-7f06-4c32-85e7-fd711dcf48ef") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:35:56.990304 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988391 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-sys-fs\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.990304 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:56.988406 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs podName:43046d78-bb7a-40ab-9e3e-d2d901471738 nodeName:}" failed. No retries permitted until 2026-07-28 16:35:57.488393878 +0000 UTC m=+2.967942465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs") pod "network-metrics-daemon-rk2lg" (UID: "43046d78-bb7a-40ab-9e3e-d2d901471738") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:35:56.991122 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988425 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-run-netns\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.991122 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988535 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-socket-dir\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.991122 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988536 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/161c4091-677f-4218-8594-cbe3d29004c7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.991122 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988655 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-dbus\") pod \"global-pull-secret-syncer-qfctx\" (UID: \"c8b7d602-7f06-4c32-85e7-fd711dcf48ef\") " pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:35:56.991122 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988702 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-multus-socket-dir-parent\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.991122 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988745 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-multus-conf-dir\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.991122 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988773 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8256e603-8e9d-41ad-b9cc-784338dddcf0-multus-daemon-config\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:56.991122 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988801 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-run-openvswitch\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.991122 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988828 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4739766-1cfe-4c32-b9a5-80b39d7ca485-ovn-node-metrics-cert\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.991122 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988933 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/161c4091-677f-4218-8594-cbe3d29004c7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.991122 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988979 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/161c4091-677f-4218-8594-cbe3d29004c7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.991122 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.988995 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-host-run-netns\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.991122 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.989027 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4739766-1cfe-4c32-b9a5-80b39d7ca485-run-openvswitch\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.991122 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.989182 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 16:35:56.991122 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.989202 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-dbus\") pod \"global-pull-secret-syncer-qfctx\" (UID: \"c8b7d602-7f06-4c32-85e7-fd711dcf48ef\") " pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:35:56.992331 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:56.992309 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:35:56.992331 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:56.992334 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:35:56.992481 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:56.992347 2570 projected.go:196] Error preparing data for projected volume kube-api-access-8rn4q for pod openshift-network-diagnostics/network-check-target-ghkxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:35:56.992481 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:56.992398 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q podName:a34f5490-8d32-4aba-808d-5d9a2b0b65e6 nodeName:}" failed. No retries permitted until 2026-07-28 16:35:57.492381803 +0000 UTC m=+2.971930397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8rn4q" (UniqueName: "kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q") pod "network-check-target-ghkxh" (UID: "a34f5490-8d32-4aba-808d-5d9a2b0b65e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:35:56.993722 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.993184 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4739766-1cfe-4c32-b9a5-80b39d7ca485-ovn-node-metrics-cert\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:56.996123 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.995667 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dvlk\" (UniqueName: \"kubernetes.io/projected/750f3037-9908-4415-9550-90fc8f863882-kube-api-access-9dvlk\") pod \"node-resolver-4ztpj\" (UID: \"750f3037-9908-4415-9550-90fc8f863882\") " pod="openshift-dns/node-resolver-4ztpj" Jul 28 16:35:56.996123 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.996086 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd2jq\" (UniqueName: \"kubernetes.io/projected/60740267-062b-483e-a3d6-c15cac4a5d70-kube-api-access-xd2jq\") pod \"iptables-alerter-cnxsw\" (UID: \"60740267-062b-483e-a3d6-c15cac4a5d70\") " pod="openshift-network-operator/iptables-alerter-cnxsw" Jul 28 16:35:56.997125 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.997099 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn8pr\" (UniqueName: \"kubernetes.io/projected/161c4091-677f-4218-8594-cbe3d29004c7-kube-api-access-jn8pr\") pod \"multus-additional-cni-plugins-77cw2\" (UID: \"161c4091-677f-4218-8594-cbe3d29004c7\") " pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:56.998015 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.997965 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr9s4\" (UniqueName: \"kubernetes.io/projected/5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235-kube-api-access-pr9s4\") pod \"aws-ebs-csi-driver-node-ltttr\" (UID: \"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:56.998325 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:56.998281 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt58z\" (UniqueName: \"kubernetes.io/projected/43046d78-bb7a-40ab-9e3e-d2d901471738-kube-api-access-wt58z\") pod \"network-metrics-daemon-rk2lg\" (UID: \"43046d78-bb7a-40ab-9e3e-d2d901471738\") " pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:35:57.002784 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.000045 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5h57\" (UniqueName: \"kubernetes.io/projected/99b4a0dc-9c95-4215-8c0c-2e18b9442836-kube-api-access-q5h57\") pod \"node-ca-2bvtp\" (UID: \"99b4a0dc-9c95-4215-8c0c-2e18b9442836\") " pod="openshift-image-registry/node-ca-2bvtp" Jul 28 16:35:57.003202 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.003057 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w6dj\" (UniqueName: \"kubernetes.io/projected/c4739766-1cfe-4c32-b9a5-80b39d7ca485-kube-api-access-2w6dj\") pod \"ovnkube-node-5rc9g\" (UID: \"c4739766-1cfe-4c32-b9a5-80b39d7ca485\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:57.051845 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.051792 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" event={"ID":"dc19e62a3119df3b706b9f3232a5ea75","Type":"ContainerStarted","Data":"61bd1136c3ade0af607d24eff5aebb6550257ad813aed28748d1fba1798f8a68"} Jul 28 16:35:57.053218 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.053189 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" event={"ID":"4b7aeeb0f4b30a61ac591fd9bec51342","Type":"ContainerStarted","Data":"1f3a4dc982775bacd4ad27d1c2b8029ee3f0d138635b5bcb9f6e441fc05d4dc3"} Jul 28 16:35:57.090124 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090092 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-tuned\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.090296 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090132 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-sys\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.090296 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090158 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-multus-socket-dir-parent\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.090296 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090179 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-multus-conf-dir\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.090296 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090199 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8256e603-8e9d-41ad-b9cc-784338dddcf0-multus-daemon-config\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.090296 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090221 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-sysconfig\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.090296 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090242 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blg9c\" (UniqueName: \"kubernetes.io/projected/f91f1f9b-2162-4684-93c6-ade306fa6522-kube-api-access-blg9c\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.090296 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090263 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9g5j\" (UniqueName: \"kubernetes.io/projected/8256e603-8e9d-41ad-b9cc-784338dddcf0-kube-api-access-t9g5j\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.090296 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090290 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-kubernetes\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.090718 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090316 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8256e603-8e9d-41ad-b9cc-784338dddcf0-cni-binary-copy\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.090718 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090340 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-run-k8s-cni-cncf-io\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.090718 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090365 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-var-lib-cni-multus\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.090718 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090388 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-var-lib-kubelet\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.090718 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090425 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-var-lib-cni-bin\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.090718 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090451 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91f1f9b-2162-4684-93c6-ade306fa6522-tmp\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.090718 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090481 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-hostroot\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.090718 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090505 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3764a6ab-bd08-4d46-a39a-0b491e8e08d6-agent-certs\") pod \"konnectivity-agent-tv4dg\" (UID: \"3764a6ab-bd08-4d46-a39a-0b491e8e08d6\") " pod="kube-system/konnectivity-agent-tv4dg" Jul 28 16:35:57.090718 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090534 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-var-lib-kubelet\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.090718 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090556 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-multus-cni-dir\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.090718 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090600 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-sysctl-d\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.090718 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090624 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-etc-kubernetes\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.090718 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090670 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-modprobe-d\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.090718 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090709 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-run\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090733 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-system-cni-dir\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090734 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-var-lib-kubelet\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090735 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-hostroot\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090741 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-sys\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090769 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-run-netns\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090781 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-multus-conf-dir\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090795 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3764a6ab-bd08-4d46-a39a-0b491e8e08d6-konnectivity-ca\") pod \"konnectivity-agent-tv4dg\" (UID: \"3764a6ab-bd08-4d46-a39a-0b491e8e08d6\") " pod="kube-system/konnectivity-agent-tv4dg" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090804 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-run-k8s-cni-cncf-io\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090784 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-multus-socket-dir-parent\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090846 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-var-lib-cni-multus\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090928 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-modprobe-d\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090900 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-sysctl-conf\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.090996 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-lib-modules\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091013 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-kubernetes\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091041 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-host\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091077 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-run-multus-certs\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091098 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-system-cni-dir\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.091420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091103 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-sysconfig\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091109 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-systemd\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091146 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-var-lib-cni-bin\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091152 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-cnibin\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091156 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-systemd\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091176 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-os-release\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091197 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-run-netns\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091244 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-run\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091278 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-host-run-multus-certs\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091291 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8256e603-8e9d-41ad-b9cc-784338dddcf0-cni-binary-copy\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091309 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-lib-modules\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091322 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-sysctl-conf\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091325 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-multus-cni-dir\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091347 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-etc-kubernetes\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091352 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-cnibin\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091372 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-var-lib-kubelet\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091400 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8256e603-8e9d-41ad-b9cc-784338dddcf0-os-release\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091425 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3764a6ab-bd08-4d46-a39a-0b491e8e08d6-konnectivity-ca\") pod \"konnectivity-agent-tv4dg\" (UID: \"3764a6ab-bd08-4d46-a39a-0b491e8e08d6\") " pod="kube-system/konnectivity-agent-tv4dg" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091440 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-host\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.092277 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091502 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-sysctl-d\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.093428 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.091900 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8256e603-8e9d-41ad-b9cc-784338dddcf0-multus-daemon-config\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.093875 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.093853 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91f1f9b-2162-4684-93c6-ade306fa6522-tmp\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.094051 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.094007 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f91f1f9b-2162-4684-93c6-ade306fa6522-etc-tuned\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.095057 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.095011 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3764a6ab-bd08-4d46-a39a-0b491e8e08d6-agent-certs\") pod \"konnectivity-agent-tv4dg\" (UID: \"3764a6ab-bd08-4d46-a39a-0b491e8e08d6\") " pod="kube-system/konnectivity-agent-tv4dg" Jul 28 16:35:57.099970 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.099946 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blg9c\" (UniqueName: \"kubernetes.io/projected/f91f1f9b-2162-4684-93c6-ade306fa6522-kube-api-access-blg9c\") pod \"tuned-bv6hj\" (UID: \"f91f1f9b-2162-4684-93c6-ade306fa6522\") " pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.100140 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.100118 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9g5j\" (UniqueName: \"kubernetes.io/projected/8256e603-8e9d-41ad-b9cc-784338dddcf0-kube-api-access-t9g5j\") pod \"multus-zqc4q\" (UID: \"8256e603-8e9d-41ad-b9cc-784338dddcf0\") " pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.123724 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.123642 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 16:35:57.176705 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.176668 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cnxsw" Jul 28 16:35:57.184821 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.184799 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:35:57.195666 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.195642 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2bvtp" Jul 28 16:35:57.202817 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.202792 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" Jul 28 16:35:57.208419 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.208400 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-77cw2" Jul 28 16:35:57.217019 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.216997 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4ztpj" Jul 28 16:35:57.224990 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.224971 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" Jul 28 16:35:57.233194 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.233168 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zqc4q" Jul 28 16:35:57.241076 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.241051 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tv4dg" Jul 28 16:35:57.494999 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.494918 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs\") pod \"network-metrics-daemon-rk2lg\" (UID: \"43046d78-bb7a-40ab-9e3e-d2d901471738\") " pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:35:57.494999 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.494978 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rn4q\" (UniqueName: \"kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q\") pod \"network-check-target-ghkxh\" (UID: \"a34f5490-8d32-4aba-808d-5d9a2b0b65e6\") " pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:35:57.495210 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.495016 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret\") pod \"global-pull-secret-syncer-qfctx\" (UID: \"c8b7d602-7f06-4c32-85e7-fd711dcf48ef\") " pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:35:57.495210 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:57.495069 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:35:57.495210 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:57.495129 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs podName:43046d78-bb7a-40ab-9e3e-d2d901471738 nodeName:}" failed. No retries permitted until 2026-07-28 16:35:58.495114215 +0000 UTC m=+3.974662787 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs") pod "network-metrics-daemon-rk2lg" (UID: "43046d78-bb7a-40ab-9e3e-d2d901471738") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:35:57.495210 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:57.495169 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:35:57.495210 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:57.495186 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:35:57.495210 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:57.495196 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:35:57.495210 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:57.495212 2570 projected.go:196] Error preparing data for projected volume kube-api-access-8rn4q for pod openshift-network-diagnostics/network-check-target-ghkxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:35:57.495462 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:57.495249 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret podName:c8b7d602-7f06-4c32-85e7-fd711dcf48ef nodeName:}" failed. No retries permitted until 2026-07-28 16:35:58.49523099 +0000 UTC m=+3.974779582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret") pod "global-pull-secret-syncer-qfctx" (UID: "c8b7d602-7f06-4c32-85e7-fd711dcf48ef") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:35:57.495462 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:57.495267 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q podName:a34f5490-8d32-4aba-808d-5d9a2b0b65e6 nodeName:}" failed. No retries permitted until 2026-07-28 16:35:58.495257762 +0000 UTC m=+3.974806348 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rn4q" (UniqueName: "kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q") pod "network-check-target-ghkxh" (UID: "a34f5490-8d32-4aba-808d-5d9a2b0b65e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:35:57.924859 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.924773 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 16:30:56 +0000 UTC" deadline="2028-04-15 01:16:48.203640264 +0000 UTC" Jul 28 16:35:57.924859 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:57.924808 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15032h40m50.278835996s" Jul 28 16:35:58.025603 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:58.025577 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3764a6ab_bd08_4d46_a39a_0b491e8e08d6.slice/crio-86af90e2a0927a6b98d02aa16a42c3bd66991fd8d9012794f59c331be13306d7 WatchSource:0}: Error finding container 86af90e2a0927a6b98d02aa16a42c3bd66991fd8d9012794f59c331be13306d7: Status 404 returned error can't find the container with id 86af90e2a0927a6b98d02aa16a42c3bd66991fd8d9012794f59c331be13306d7 Jul 28 16:35:58.027204 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:58.027184 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4739766_1cfe_4c32_b9a5_80b39d7ca485.slice/crio-4712805f7d9e8a7451df49a3a6902993c7aa9f62d7018d56f8a83bba84861ae9 WatchSource:0}: Error finding container 4712805f7d9e8a7451df49a3a6902993c7aa9f62d7018d56f8a83bba84861ae9: Status 404 returned error can't find the container with id 4712805f7d9e8a7451df49a3a6902993c7aa9f62d7018d56f8a83bba84861ae9 Jul 28 16:35:58.028081 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:58.028062 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8256e603_8e9d_41ad_b9cc_784338dddcf0.slice/crio-9329739d4ce0a3cf70eb4bd37cbe835db8460b2e2464e792a5f94b8199bde0ab WatchSource:0}: Error finding container 9329739d4ce0a3cf70eb4bd37cbe835db8460b2e2464e792a5f94b8199bde0ab: Status 404 returned error can't find the container with id 9329739d4ce0a3cf70eb4bd37cbe835db8460b2e2464e792a5f94b8199bde0ab Jul 28 16:35:58.028949 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:58.028897 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b4a0dc_9c95_4215_8c0c_2e18b9442836.slice/crio-daae927ec3aa8dfc5d317e5cc8366299684116d82bf8cf9db8d6a9d4e565aaf7 WatchSource:0}: Error finding container daae927ec3aa8dfc5d317e5cc8366299684116d82bf8cf9db8d6a9d4e565aaf7: Status 404 returned error can't find the container with id daae927ec3aa8dfc5d317e5cc8366299684116d82bf8cf9db8d6a9d4e565aaf7 Jul 28 16:35:58.032541 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:35:58.032517 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fdbc81e_5ca8_4ef7_b37f_fb8f7d903235.slice/crio-bc38d2f0323f95373ecde256276f903f544b4a13432dd7182d2db4eb19c7f8ef WatchSource:0}: Error finding container bc38d2f0323f95373ecde256276f903f544b4a13432dd7182d2db4eb19c7f8ef: Status 404 returned error can't find the container with id bc38d2f0323f95373ecde256276f903f544b4a13432dd7182d2db4eb19c7f8ef Jul 28 16:35:58.056227 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:58.056192 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-77cw2" event={"ID":"161c4091-677f-4218-8594-cbe3d29004c7","Type":"ContainerStarted","Data":"0988685a4912ca4f90ee3257fe0eb903845bdf6764f1b01984cda4afbdc46e3f"} Jul 28 16:35:58.057311 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:58.057286 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cnxsw" event={"ID":"60740267-062b-483e-a3d6-c15cac4a5d70","Type":"ContainerStarted","Data":"978d1a6737adbfaa682e6a5a11def13f8d2ccb1436d60959d23fc136c9823944"} Jul 28 16:35:58.058374 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:58.058352 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" event={"ID":"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235","Type":"ContainerStarted","Data":"bc38d2f0323f95373ecde256276f903f544b4a13432dd7182d2db4eb19c7f8ef"} Jul 28 16:35:58.059424 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:58.059398 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4ztpj" event={"ID":"750f3037-9908-4415-9550-90fc8f863882","Type":"ContainerStarted","Data":"3298a9a11d3a37319272982a935e8f690fb66e3e8bdbfe13daf23f5f1b944ad9"} Jul 28 16:35:58.060396 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:58.060376 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" event={"ID":"f91f1f9b-2162-4684-93c6-ade306fa6522","Type":"ContainerStarted","Data":"778f12bc87fe6890b045ee6b1d5d1ab4dd89953628d09822697dad96d856d7c7"} Jul 28 16:35:58.061975 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:58.061955 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2bvtp" event={"ID":"99b4a0dc-9c95-4215-8c0c-2e18b9442836","Type":"ContainerStarted","Data":"daae927ec3aa8dfc5d317e5cc8366299684116d82bf8cf9db8d6a9d4e565aaf7"} Jul 28 16:35:58.064504 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:58.064484 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zqc4q" event={"ID":"8256e603-8e9d-41ad-b9cc-784338dddcf0","Type":"ContainerStarted","Data":"9329739d4ce0a3cf70eb4bd37cbe835db8460b2e2464e792a5f94b8199bde0ab"} Jul 28 16:35:58.067652 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:58.067629 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" event={"ID":"c4739766-1cfe-4c32-b9a5-80b39d7ca485","Type":"ContainerStarted","Data":"4712805f7d9e8a7451df49a3a6902993c7aa9f62d7018d56f8a83bba84861ae9"} Jul 28 16:35:58.070069 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:58.070047 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tv4dg" event={"ID":"3764a6ab-bd08-4d46-a39a-0b491e8e08d6","Type":"ContainerStarted","Data":"86af90e2a0927a6b98d02aa16a42c3bd66991fd8d9012794f59c331be13306d7"} Jul 28 16:35:58.503269 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:58.502942 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rn4q\" (UniqueName: \"kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q\") pod \"network-check-target-ghkxh\" (UID: \"a34f5490-8d32-4aba-808d-5d9a2b0b65e6\") " pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:35:58.503269 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:58.503241 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret\") pod \"global-pull-secret-syncer-qfctx\" (UID: \"c8b7d602-7f06-4c32-85e7-fd711dcf48ef\") " pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:35:58.503483 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:58.503286 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs\") pod \"network-metrics-daemon-rk2lg\" (UID: \"43046d78-bb7a-40ab-9e3e-d2d901471738\") " pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:35:58.503483 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:58.503419 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:35:58.503483 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:58.503479 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs podName:43046d78-bb7a-40ab-9e3e-d2d901471738 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:00.503461228 +0000 UTC m=+5.983009805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs") pod "network-metrics-daemon-rk2lg" (UID: "43046d78-bb7a-40ab-9e3e-d2d901471738") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:35:58.503913 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:58.503894 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:35:58.504006 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:58.503920 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:35:58.504006 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:58.503934 2570 projected.go:196] Error preparing data for projected volume kube-api-access-8rn4q for pod openshift-network-diagnostics/network-check-target-ghkxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:35:58.504006 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:58.503980 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q podName:a34f5490-8d32-4aba-808d-5d9a2b0b65e6 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:00.503965836 +0000 UTC m=+5.983514408 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rn4q" (UniqueName: "kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q") pod "network-check-target-ghkxh" (UID: "a34f5490-8d32-4aba-808d-5d9a2b0b65e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:35:58.504176 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:58.504046 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:35:58.504176 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:58.504079 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret podName:c8b7d602-7f06-4c32-85e7-fd711dcf48ef nodeName:}" failed. No retries permitted until 2026-07-28 16:36:00.504066796 +0000 UTC m=+5.983615368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret") pod "global-pull-secret-syncer-qfctx" (UID: "c8b7d602-7f06-4c32-85e7-fd711dcf48ef") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:35:58.925854 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:58.925768 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 16:30:56 +0000 UTC" deadline="2028-05-06 08:05:42.648160988 +0000 UTC" Jul 28 16:35:58.925854 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:58.925824 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15543h29m43.722340811s" Jul 28 16:35:59.050761 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:59.050733 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:35:59.050936 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:59.050866 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfctx" podUID="c8b7d602-7f06-4c32-85e7-fd711dcf48ef" Jul 28 16:35:59.051252 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:59.051235 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:35:59.051343 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:59.051315 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk2lg" podUID="43046d78-bb7a-40ab-9e3e-d2d901471738" Jul 28 16:35:59.051403 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:59.051374 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:35:59.051455 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:35:59.051415 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghkxh" podUID="a34f5490-8d32-4aba-808d-5d9a2b0b65e6" Jul 28 16:35:59.083945 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:59.083657 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" event={"ID":"dc19e62a3119df3b706b9f3232a5ea75","Type":"ContainerStarted","Data":"69bc7c52d28b7227eaad578a0f1bbd54a5e314c2d45179fb01e583c3b3521824"} Jul 28 16:35:59.098472 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:59.097845 2570 generic.go:356] "Generic (PLEG): container finished" podID="4b7aeeb0f4b30a61ac591fd9bec51342" containerID="5f7f9519fc6a6749b8c12cbc8e4214b0c54863b9f090a7490c2581d4c304b57a" exitCode=0 Jul 28 16:35:59.098472 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:59.097889 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" event={"ID":"4b7aeeb0f4b30a61ac591fd9bec51342","Type":"ContainerDied","Data":"5f7f9519fc6a6749b8c12cbc8e4214b0c54863b9f090a7490c2581d4c304b57a"} Jul 28 16:35:59.113217 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:35:59.113165 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" podStartSLOduration=3.113142594 podStartE2EDuration="3.113142594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:35:59.098265266 +0000 UTC m=+4.577813863" watchObservedRunningTime="2026-07-28 16:35:59.113142594 +0000 UTC m=+4.592691189" Jul 28 16:36:00.123330 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:00.123256 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" event={"ID":"4b7aeeb0f4b30a61ac591fd9bec51342","Type":"ContainerStarted","Data":"e9d3adcfbe12fbcbc223a40b6d85ca0ae5373ed3bf12b270204a0007dc184d63"} Jul 28 16:36:00.521659 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:00.521405 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret\") pod \"global-pull-secret-syncer-qfctx\" (UID: \"c8b7d602-7f06-4c32-85e7-fd711dcf48ef\") " pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:00.521659 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:00.521458 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs\") pod \"network-metrics-daemon-rk2lg\" (UID: \"43046d78-bb7a-40ab-9e3e-d2d901471738\") " pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:00.521659 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:00.521508 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rn4q\" (UniqueName: \"kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q\") pod \"network-check-target-ghkxh\" (UID: \"a34f5490-8d32-4aba-808d-5d9a2b0b65e6\") " pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:00.521962 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:00.521667 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:36:00.521962 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:00.521700 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:36:00.521962 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:00.521714 2570 projected.go:196] Error preparing data for projected volume kube-api-access-8rn4q for pod openshift-network-diagnostics/network-check-target-ghkxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:36:00.521962 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:00.521770 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q podName:a34f5490-8d32-4aba-808d-5d9a2b0b65e6 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:04.521752048 +0000 UTC m=+10.001300620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rn4q" (UniqueName: "kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q") pod "network-check-target-ghkxh" (UID: "a34f5490-8d32-4aba-808d-5d9a2b0b65e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:36:00.522181 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:00.522152 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:36:00.522242 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:00.522201 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret podName:c8b7d602-7f06-4c32-85e7-fd711dcf48ef nodeName:}" failed. No retries permitted until 2026-07-28 16:36:04.522186331 +0000 UTC m=+10.001734904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret") pod "global-pull-secret-syncer-qfctx" (UID: "c8b7d602-7f06-4c32-85e7-fd711dcf48ef") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:36:00.522304 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:00.522253 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:36:00.522304 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:00.522295 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs podName:43046d78-bb7a-40ab-9e3e-d2d901471738 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:04.522275071 +0000 UTC m=+10.001823649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs") pod "network-metrics-daemon-rk2lg" (UID: "43046d78-bb7a-40ab-9e3e-d2d901471738") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:36:01.047439 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:01.047365 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:01.047607 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:01.047495 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfctx" podUID="c8b7d602-7f06-4c32-85e7-fd711dcf48ef" Jul 28 16:36:01.047914 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:01.047889 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:01.048013 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:01.047992 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk2lg" podUID="43046d78-bb7a-40ab-9e3e-d2d901471738" Jul 28 16:36:01.048084 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:01.047889 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:01.048084 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:01.048071 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghkxh" podUID="a34f5490-8d32-4aba-808d-5d9a2b0b65e6" Jul 28 16:36:03.050756 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:03.050584 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:03.050756 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:03.050730 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfctx" podUID="c8b7d602-7f06-4c32-85e7-fd711dcf48ef" Jul 28 16:36:03.051285 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:03.051101 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:03.051285 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:03.051208 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk2lg" podUID="43046d78-bb7a-40ab-9e3e-d2d901471738" Jul 28 16:36:03.051285 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:03.051257 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:03.051436 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:03.051325 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghkxh" podUID="a34f5490-8d32-4aba-808d-5d9a2b0b65e6" Jul 28 16:36:04.558738 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:04.558684 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs\") pod \"network-metrics-daemon-rk2lg\" (UID: \"43046d78-bb7a-40ab-9e3e-d2d901471738\") " pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:04.559124 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:04.558774 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rn4q\" (UniqueName: \"kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q\") pod \"network-check-target-ghkxh\" (UID: \"a34f5490-8d32-4aba-808d-5d9a2b0b65e6\") " pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:04.559124 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:04.558817 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret\") pod \"global-pull-secret-syncer-qfctx\" (UID: \"c8b7d602-7f06-4c32-85e7-fd711dcf48ef\") " pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:04.559124 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:04.558937 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:36:04.559124 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:04.558999 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret podName:c8b7d602-7f06-4c32-85e7-fd711dcf48ef nodeName:}" failed. No retries permitted until 2026-07-28 16:36:12.55898127 +0000 UTC m=+18.038529849 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret") pod "global-pull-secret-syncer-qfctx" (UID: "c8b7d602-7f06-4c32-85e7-fd711dcf48ef") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:36:04.559404 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:04.559387 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:36:04.559452 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:04.559442 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs podName:43046d78-bb7a-40ab-9e3e-d2d901471738 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:12.559426498 +0000 UTC m=+18.038975072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs") pod "network-metrics-daemon-rk2lg" (UID: "43046d78-bb7a-40ab-9e3e-d2d901471738") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:36:04.559533 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:04.559522 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:36:04.559567 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:04.559544 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:36:04.559567 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:04.559557 2570 projected.go:196] Error preparing data for projected volume kube-api-access-8rn4q for pod openshift-network-diagnostics/network-check-target-ghkxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:36:04.559626 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:04.559592 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q podName:a34f5490-8d32-4aba-808d-5d9a2b0b65e6 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:12.559581996 +0000 UTC m=+18.039130571 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rn4q" (UniqueName: "kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q") pod "network-check-target-ghkxh" (UID: "a34f5490-8d32-4aba-808d-5d9a2b0b65e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:36:05.047774 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:05.047679 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:05.047975 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:05.047825 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfctx" podUID="c8b7d602-7f06-4c32-85e7-fd711dcf48ef" Jul 28 16:36:05.048253 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:05.048213 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:05.050485 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:05.050373 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk2lg" podUID="43046d78-bb7a-40ab-9e3e-d2d901471738" Jul 28 16:36:05.050485 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:05.050457 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:05.050656 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:05.050560 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghkxh" podUID="a34f5490-8d32-4aba-808d-5d9a2b0b65e6" Jul 28 16:36:07.047354 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:07.047320 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:07.047820 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:07.047320 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:07.047820 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:07.047468 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk2lg" podUID="43046d78-bb7a-40ab-9e3e-d2d901471738" Jul 28 16:36:07.047820 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:07.047545 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfctx" podUID="c8b7d602-7f06-4c32-85e7-fd711dcf48ef" Jul 28 16:36:07.047820 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:07.047598 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:07.047820 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:07.047660 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghkxh" podUID="a34f5490-8d32-4aba-808d-5d9a2b0b65e6" Jul 28 16:36:09.048029 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:09.047943 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:09.048457 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:09.047943 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:09.048457 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:09.048083 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfctx" podUID="c8b7d602-7f06-4c32-85e7-fd711dcf48ef" Jul 28 16:36:09.048457 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:09.047950 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:09.048457 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:09.048163 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghkxh" podUID="a34f5490-8d32-4aba-808d-5d9a2b0b65e6" Jul 28 16:36:09.048457 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:09.048273 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk2lg" podUID="43046d78-bb7a-40ab-9e3e-d2d901471738" Jul 28 16:36:11.047846 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:11.047814 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:11.048404 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:11.047814 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:11.048404 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:11.047968 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk2lg" podUID="43046d78-bb7a-40ab-9e3e-d2d901471738" Jul 28 16:36:11.048404 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:11.048036 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghkxh" podUID="a34f5490-8d32-4aba-808d-5d9a2b0b65e6" Jul 28 16:36:11.048404 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:11.047817 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:11.048404 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:11.048130 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfctx" podUID="c8b7d602-7f06-4c32-85e7-fd711dcf48ef" Jul 28 16:36:12.622015 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:12.621981 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs\") pod \"network-metrics-daemon-rk2lg\" (UID: \"43046d78-bb7a-40ab-9e3e-d2d901471738\") " pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:12.622442 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:12.622033 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rn4q\" (UniqueName: \"kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q\") pod \"network-check-target-ghkxh\" (UID: \"a34f5490-8d32-4aba-808d-5d9a2b0b65e6\") " pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:12.622442 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:12.622059 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret\") pod \"global-pull-secret-syncer-qfctx\" (UID: \"c8b7d602-7f06-4c32-85e7-fd711dcf48ef\") " pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:12.622442 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:12.622162 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:36:12.622442 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:12.622171 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:36:12.622442 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:12.622220 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret podName:c8b7d602-7f06-4c32-85e7-fd711dcf48ef nodeName:}" failed. No retries permitted until 2026-07-28 16:36:28.622204029 +0000 UTC m=+34.101752604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret") pod "global-pull-secret-syncer-qfctx" (UID: "c8b7d602-7f06-4c32-85e7-fd711dcf48ef") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:36:12.622442 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:12.622179 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:36:12.622442 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:12.622234 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs podName:43046d78-bb7a-40ab-9e3e-d2d901471738 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:28.622228066 +0000 UTC m=+34.101776637 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs") pod "network-metrics-daemon-rk2lg" (UID: "43046d78-bb7a-40ab-9e3e-d2d901471738") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:36:12.622442 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:12.622249 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:36:12.622442 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:12.622266 2570 projected.go:196] Error preparing data for projected volume kube-api-access-8rn4q for pod openshift-network-diagnostics/network-check-target-ghkxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:36:12.622442 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:12.622315 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q podName:a34f5490-8d32-4aba-808d-5d9a2b0b65e6 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:28.622297867 +0000 UTC m=+34.101846439 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rn4q" (UniqueName: "kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q") pod "network-check-target-ghkxh" (UID: "a34f5490-8d32-4aba-808d-5d9a2b0b65e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:36:13.048338 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:13.048299 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:13.048527 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:13.048351 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:13.048527 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:13.048301 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:13.048527 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:13.048441 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfctx" podUID="c8b7d602-7f06-4c32-85e7-fd711dcf48ef" Jul 28 16:36:13.048711 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:13.048607 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk2lg" podUID="43046d78-bb7a-40ab-9e3e-d2d901471738" Jul 28 16:36:13.048789 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:13.048701 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghkxh" podUID="a34f5490-8d32-4aba-808d-5d9a2b0b65e6" Jul 28 16:36:15.048875 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:15.048835 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:15.049403 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:15.048948 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:15.049403 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:15.048961 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfctx" podUID="c8b7d602-7f06-4c32-85e7-fd711dcf48ef" Jul 28 16:36:15.049403 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:15.049040 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghkxh" podUID="a34f5490-8d32-4aba-808d-5d9a2b0b65e6" Jul 28 16:36:15.049403 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:15.049103 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:15.049403 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:15.049173 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk2lg" podUID="43046d78-bb7a-40ab-9e3e-d2d901471738" Jul 28 16:36:17.049717 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:17.047549 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:17.049717 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:17.047666 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfctx" podUID="c8b7d602-7f06-4c32-85e7-fd711dcf48ef" Jul 28 16:36:17.049717 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:17.048248 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:17.049717 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:17.048355 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk2lg" podUID="43046d78-bb7a-40ab-9e3e-d2d901471738" Jul 28 16:36:17.049717 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:17.048406 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:17.049717 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:17.048469 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghkxh" podUID="a34f5490-8d32-4aba-808d-5d9a2b0b65e6" Jul 28 16:36:17.159706 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:17.159544 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" event={"ID":"f91f1f9b-2162-4684-93c6-ade306fa6522","Type":"ContainerStarted","Data":"35db71ccbd7ea0a173df446038cec9d88a45bf0da169342bc255fe3b660bfcc8"} Jul 28 16:36:17.161310 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:17.161285 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zqc4q" event={"ID":"8256e603-8e9d-41ad-b9cc-784338dddcf0","Type":"ContainerStarted","Data":"2ab1c0e494051cee37324be67a399ab668a06193774691b3d350cdf0ed4e30d1"} Jul 28 16:36:17.163021 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:17.162998 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tv4dg" event={"ID":"3764a6ab-bd08-4d46-a39a-0b491e8e08d6","Type":"ContainerStarted","Data":"59aacf1fab93eff4c4ec2daaf949c073d774eaab1aed3b52f9e5e3aa3dd5ba27"} Jul 28 16:36:17.177748 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:17.177329 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bv6hj" podStartSLOduration=3.260026678 podStartE2EDuration="22.17731289s" totalImagesPullingTime="18.917286212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:17.176914622 +0000 UTC m=+22.656463217" watchObservedRunningTime="2026-07-28 16:36:17.17731289 +0000 UTC m=+22.656861483" Jul 28 16:36:17.177748 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:17.177564 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" podStartSLOduration=21.177554172 podStartE2EDuration="21.177554172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:00.142350837 +0000 UTC m=+5.621899422" watchObservedRunningTime="2026-07-28 16:36:17.177554172 +0000 UTC m=+22.657102767" Jul 28 16:36:17.195298 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:17.195060 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zqc4q" podStartSLOduration=3.197544266 podStartE2EDuration="22.195035134s" totalImagesPullingTime="18.997490868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:17.194240109 +0000 UTC m=+22.673788702" watchObservedRunningTime="2026-07-28 16:36:17.195035134 +0000 UTC m=+22.674583730" Jul 28 16:36:17.209239 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:17.209168 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tv4dg" podStartSLOduration=3.28097283 podStartE2EDuration="22.209146029s" totalImagesPullingTime="18.928173199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:17.208648428 +0000 UTC m=+22.688197022" watchObservedRunningTime="2026-07-28 16:36:17.209146029 +0000 UTC m=+22.688694625" Jul 28 16:36:18.166418 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.166187 2570 generic.go:356] "Generic (PLEG): container finished" podID="161c4091-677f-4218-8594-cbe3d29004c7" containerID="79408702c1b73fd123c22dba3d6d84e3f75e406ece7e713213d9775e28857bb0" exitCode=0 Jul 28 16:36:18.167083 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.166251 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-77cw2" event={"ID":"161c4091-677f-4218-8594-cbe3d29004c7","Type":"ContainerDied","Data":"79408702c1b73fd123c22dba3d6d84e3f75e406ece7e713213d9775e28857bb0"} Jul 28 16:36:18.167891 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.167871 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cnxsw" event={"ID":"60740267-062b-483e-a3d6-c15cac4a5d70","Type":"ContainerStarted","Data":"e74c08bd4e7a22588f6c4d3f30fe6c45bb8f4a0c98a5e8f0b4dcf72827aa6c9a"} Jul 28 16:36:18.169182 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.169162 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" event={"ID":"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235","Type":"ContainerStarted","Data":"4595c36fcb3383ef04f8e75ac7075aa31c5bde9e2063c0e8a1cf722a964b1fd3"} Jul 28 16:36:18.173423 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.170521 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4ztpj" event={"ID":"750f3037-9908-4415-9550-90fc8f863882","Type":"ContainerStarted","Data":"c2e6ca14d74b8c820dde51a67915653e16e60c02c8552b0b317c06c0e9607bf7"} Jul 28 16:36:18.174929 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.174905 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2bvtp" event={"ID":"99b4a0dc-9c95-4215-8c0c-2e18b9442836","Type":"ContainerStarted","Data":"9a03a7fbfacd92df3a44c7f3d7900d0b57074cb864855a174d72a2c720d6eefa"} Jul 28 16:36:18.177620 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.177596 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" event={"ID":"c4739766-1cfe-4c32-b9a5-80b39d7ca485","Type":"ContainerStarted","Data":"c68648a33c6b5e5cdd73099a196dff0f232e81e27c6779dc88492677237a610c"} Jul 28 16:36:18.177734 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.177653 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" event={"ID":"c4739766-1cfe-4c32-b9a5-80b39d7ca485","Type":"ContainerStarted","Data":"c1d8f2c661a1516e71a360ed1bb6a0080a410e649a631df6488c28923ac008c1"} Jul 28 16:36:18.177734 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.177716 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" event={"ID":"c4739766-1cfe-4c32-b9a5-80b39d7ca485","Type":"ContainerStarted","Data":"a1c0982f5880fc61e7c26b56f5d93ef7a95210a3ca33de96adf99137d93b1132"} Jul 28 16:36:18.177807 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.177746 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" event={"ID":"c4739766-1cfe-4c32-b9a5-80b39d7ca485","Type":"ContainerStarted","Data":"9351eb77d769c1adbc7e3b0f33b7c456dcafc1bc50d90f4116477a9c67c6b8a1"} Jul 28 16:36:18.177807 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.177774 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" event={"ID":"c4739766-1cfe-4c32-b9a5-80b39d7ca485","Type":"ContainerStarted","Data":"aabfc28fa84c5daa4f93a9d0b2a54b7f6fac2ea29c1ff4fc254f0686e9ffba3f"} Jul 28 16:36:18.177807 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.177802 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" event={"ID":"c4739766-1cfe-4c32-b9a5-80b39d7ca485","Type":"ContainerStarted","Data":"90cd87b45dffe6cfe9be9980c1f5e6cf0a734720f247cc53655e5ac226b1d2ec"} Jul 28 16:36:18.219170 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.219126 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4ztpj" podStartSLOduration=4.268037224 podStartE2EDuration="23.219111999s" totalImagesPullingTime="18.951074775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:18.218676909 +0000 UTC m=+23.698225503" watchObservedRunningTime="2026-07-28 16:36:18.219111999 +0000 UTC m=+23.698660593" Jul 28 16:36:18.219303 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.219193 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2bvtp" podStartSLOduration=4.270970571 podStartE2EDuration="23.21918926s" totalImagesPullingTime="18.948218689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:18.20229469 +0000 UTC m=+23.681843284" watchObservedRunningTime="2026-07-28 16:36:18.21918926 +0000 UTC m=+23.698737853" Jul 28 16:36:18.234134 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.234095 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cnxsw" podStartSLOduration=4.292361784 podStartE2EDuration="23.234080007s" totalImagesPullingTime="18.941718223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:18.233797887 +0000 UTC m=+23.713346475" watchObservedRunningTime="2026-07-28 16:36:18.234080007 +0000 UTC m=+23.713628622" Jul 28 16:36:18.413729 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.413704 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 16:36:18.947751 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.947627 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T16:36:18.413723056Z","UUID":"a0b772a6-db82-496e-bf6e-fbea4b648349","Handler":null,"Name":"","Endpoint":""} Jul 28 16:36:18.950035 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.949949 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 16:36:18.950355 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:18.950172 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 16:36:19.051793 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:19.051762 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:19.051978 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:19.051835 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:19.051978 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:19.051953 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:19.052096 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:19.051951 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghkxh" podUID="a34f5490-8d32-4aba-808d-5d9a2b0b65e6" Jul 28 16:36:19.052149 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:19.052111 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk2lg" podUID="43046d78-bb7a-40ab-9e3e-d2d901471738" Jul 28 16:36:19.052228 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:19.052201 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfctx" podUID="c8b7d602-7f06-4c32-85e7-fd711dcf48ef" Jul 28 16:36:19.182787 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:19.182747 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" event={"ID":"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235","Type":"ContainerStarted","Data":"f7d9e170ba739d243f763c3a8492baa747a33fcca756b9adf84df6f0b6cb671c"} Jul 28 16:36:20.188361 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:20.188322 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" event={"ID":"c4739766-1cfe-4c32-b9a5-80b39d7ca485","Type":"ContainerStarted","Data":"10acc4238c81376f97085abd996157d3b21b5b22b690f1f83650e69a7f83a68f"} Jul 28 16:36:20.190612 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:20.190584 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" event={"ID":"5fdbc81e-5ca8-4ef7-b37f-fb8f7d903235","Type":"ContainerStarted","Data":"fdba3a6f4637e1c8cea0856870e818c9ced43ad84babea881a6278ae889ccefc"} Jul 28 16:36:20.209544 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:20.209493 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltttr" podStartSLOduration=4.259766385 podStartE2EDuration="25.209472606s" totalImagesPullingTime="20.949706221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:20.208778369 +0000 UTC m=+25.688326964" watchObservedRunningTime="2026-07-28 16:36:20.209472606 +0000 UTC m=+25.689021201" Jul 28 16:36:20.465266 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:20.465181 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tv4dg" Jul 28 16:36:20.465856 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:20.465830 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tv4dg" Jul 28 16:36:21.048180 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:21.048146 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:21.048180 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:21.048173 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:21.048423 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:21.048274 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfctx" podUID="c8b7d602-7f06-4c32-85e7-fd711dcf48ef" Jul 28 16:36:21.048423 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:21.048336 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk2lg" podUID="43046d78-bb7a-40ab-9e3e-d2d901471738" Jul 28 16:36:21.048528 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:21.048146 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:21.048574 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:21.048532 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghkxh" podUID="a34f5490-8d32-4aba-808d-5d9a2b0b65e6" Jul 28 16:36:23.048424 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:23.048242 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:23.049145 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:23.048251 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:23.049145 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:23.048501 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghkxh" podUID="a34f5490-8d32-4aba-808d-5d9a2b0b65e6" Jul 28 16:36:23.049145 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:23.048260 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:23.049145 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:23.048590 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfctx" podUID="c8b7d602-7f06-4c32-85e7-fd711dcf48ef" Jul 28 16:36:23.049145 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:23.048676 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk2lg" podUID="43046d78-bb7a-40ab-9e3e-d2d901471738" Jul 28 16:36:23.201161 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:23.201066 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" event={"ID":"c4739766-1cfe-4c32-b9a5-80b39d7ca485","Type":"ContainerStarted","Data":"b7fd2c502d1a247695f205e74d42da692a735fcdfbd2c0ce079748cbd5db8012"} Jul 28 16:36:23.204172 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:23.201795 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:36:23.204172 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:23.201974 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:36:23.205800 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:23.205779 2570 generic.go:356] "Generic (PLEG): container finished" podID="161c4091-677f-4218-8594-cbe3d29004c7" containerID="94896d75283f0c170c828115d29d6bddc1a0c4c6eb23d4c37a46f1c86d61571c" exitCode=0 Jul 28 16:36:23.205899 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:23.205808 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-77cw2" event={"ID":"161c4091-677f-4218-8594-cbe3d29004c7","Type":"ContainerDied","Data":"94896d75283f0c170c828115d29d6bddc1a0c4c6eb23d4c37a46f1c86d61571c"} Jul 28 16:36:23.220166 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:23.220145 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:36:23.229769 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:23.229732 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" podStartSLOduration=9.20235509 podStartE2EDuration="28.229719752s" totalImagesPullingTime="19.027364662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:23.229159186 +0000 UTC m=+28.708707780" watchObservedRunningTime="2026-07-28 16:36:23.229719752 +0000 UTC m=+28.709268345" Jul 28 16:36:24.047006 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:24.046818 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tv4dg" Jul 28 16:36:24.047178 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:24.047104 2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 16:36:24.047468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:24.047448 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tv4dg" Jul 28 16:36:24.207954 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:24.207909 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:36:24.224595 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:24.224573 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:36:24.464156 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:24.464126 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rk2lg"] Jul 28 16:36:24.464325 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:24.464309 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:24.464566 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:24.464419 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk2lg" podUID="43046d78-bb7a-40ab-9e3e-d2d901471738" Jul 28 16:36:24.465070 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:24.465028 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qfctx"] Jul 28 16:36:24.465195 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:24.465172 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:24.465294 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:24.465270 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfctx" podUID="c8b7d602-7f06-4c32-85e7-fd711dcf48ef" Jul 28 16:36:24.465667 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:24.465647 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ghkxh"] Jul 28 16:36:24.465836 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:24.465786 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:24.465914 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:24.465891 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghkxh" podUID="a34f5490-8d32-4aba-808d-5d9a2b0b65e6" Jul 28 16:36:25.211961 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:25.211927 2570 generic.go:356] "Generic (PLEG): container finished" podID="161c4091-677f-4218-8594-cbe3d29004c7" containerID="307c15aca13019ba2a222ee85b12952f017d3d82386447a30fe07553a6b05fc7" exitCode=0 Jul 28 16:36:25.212609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:25.212003 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-77cw2" event={"ID":"161c4091-677f-4218-8594-cbe3d29004c7","Type":"ContainerDied","Data":"307c15aca13019ba2a222ee85b12952f017d3d82386447a30fe07553a6b05fc7"} Jul 28 16:36:26.047500 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:26.047469 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:26.047626 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:26.047508 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:26.047626 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:26.047510 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:26.047626 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:26.047597 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk2lg" podUID="43046d78-bb7a-40ab-9e3e-d2d901471738" Jul 28 16:36:26.047735 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:26.047681 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfctx" podUID="c8b7d602-7f06-4c32-85e7-fd711dcf48ef" Jul 28 16:36:26.047773 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:26.047754 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghkxh" podUID="a34f5490-8d32-4aba-808d-5d9a2b0b65e6" Jul 28 16:36:26.216464 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:26.216395 2570 generic.go:356] "Generic (PLEG): container finished" podID="161c4091-677f-4218-8594-cbe3d29004c7" containerID="3a5b59facda4bcb902ed2fbd4209466952d75c7389510c962c4d299555171558" exitCode=0 Jul 28 16:36:26.216817 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:26.216480 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-77cw2" event={"ID":"161c4091-677f-4218-8594-cbe3d29004c7","Type":"ContainerDied","Data":"3a5b59facda4bcb902ed2fbd4209466952d75c7389510c962c4d299555171558"} Jul 28 16:36:28.047938 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:28.047726 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:28.048462 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:28.047764 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:28.048462 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:28.048039 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghkxh" podUID="a34f5490-8d32-4aba-808d-5d9a2b0b65e6" Jul 28 16:36:28.048462 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:28.047851 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:28.048462 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:28.048112 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfctx" podUID="c8b7d602-7f06-4c32-85e7-fd711dcf48ef" Jul 28 16:36:28.048462 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:28.048190 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk2lg" podUID="43046d78-bb7a-40ab-9e3e-d2d901471738" Jul 28 16:36:28.636412 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:28.636380 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs\") pod \"network-metrics-daemon-rk2lg\" (UID: \"43046d78-bb7a-40ab-9e3e-d2d901471738\") " pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:28.636601 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:28.636433 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rn4q\" (UniqueName: \"kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q\") pod \"network-check-target-ghkxh\" (UID: \"a34f5490-8d32-4aba-808d-5d9a2b0b65e6\") " pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:28.636601 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:28.636473 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret\") pod \"global-pull-secret-syncer-qfctx\" (UID: \"c8b7d602-7f06-4c32-85e7-fd711dcf48ef\") " pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:28.636601 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:28.636541 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:36:28.636601 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:28.636549 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:36:28.636832 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:28.636608 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret podName:c8b7d602-7f06-4c32-85e7-fd711dcf48ef nodeName:}" failed. No retries permitted until 2026-07-28 16:37:00.636593333 +0000 UTC m=+66.116141906 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret") pod "global-pull-secret-syncer-qfctx" (UID: "c8b7d602-7f06-4c32-85e7-fd711dcf48ef") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:36:28.636832 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:28.636624 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs podName:43046d78-bb7a-40ab-9e3e-d2d901471738 nodeName:}" failed. No retries permitted until 2026-07-28 16:37:00.636616446 +0000 UTC m=+66.116165017 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs") pod "network-metrics-daemon-rk2lg" (UID: "43046d78-bb7a-40ab-9e3e-d2d901471738") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:36:28.636832 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:28.636631 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:36:28.636832 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:28.636654 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:36:28.636832 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:28.636667 2570 projected.go:196] Error preparing data for projected volume kube-api-access-8rn4q for pod openshift-network-diagnostics/network-check-target-ghkxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:36:28.636832 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:28.636748 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q podName:a34f5490-8d32-4aba-808d-5d9a2b0b65e6 nodeName:}" failed. No retries permitted until 2026-07-28 16:37:00.636729018 +0000 UTC m=+66.116277601 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rn4q" (UniqueName: "kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q") pod "network-check-target-ghkxh" (UID: "a34f5490-8d32-4aba-808d-5d9a2b0b65e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:36:29.821291 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.821260 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeReady" Jul 28 16:36:29.821741 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.821433 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 16:36:29.867146 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.867114 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dk8k8"] Jul 28 16:36:29.873971 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.873943 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kc5n4"] Jul 28 16:36:29.874130 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.874045 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:29.877041 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.876831 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 16:36:29.877041 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.876838 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2sch7\"" Jul 28 16:36:29.877041 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.876910 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 16:36:29.878419 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.878398 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kc5n4" Jul 28 16:36:29.880395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.880373 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 16:36:29.880505 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.880494 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h56h7\"" Jul 28 16:36:29.880835 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.880814 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 16:36:29.880918 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.880854 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 16:36:29.884567 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.884546 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dk8k8"] Jul 28 16:36:29.885281 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.885261 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kc5n4"] Jul 28 16:36:29.944933 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.944899 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-config-volume\") pod \"dns-default-dk8k8\" (UID: \"c33d7eac-0a52-4dd3-ac04-8270ea27bb01\") " pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:29.945123 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.944973 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls\") pod \"dns-default-dk8k8\" (UID: \"c33d7eac-0a52-4dd3-ac04-8270ea27bb01\") " pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:29.945123 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.945074 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkthz\" (UniqueName: \"kubernetes.io/projected/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-kube-api-access-nkthz\") pod \"dns-default-dk8k8\" (UID: \"c33d7eac-0a52-4dd3-ac04-8270ea27bb01\") " pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:29.945123 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:29.945104 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-tmp-dir\") pod \"dns-default-dk8k8\" (UID: \"c33d7eac-0a52-4dd3-ac04-8270ea27bb01\") " pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:30.046268 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.046238 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th22p\" (UniqueName: \"kubernetes.io/projected/7a0189c0-e01f-4b0c-94db-a61478aac890-kube-api-access-th22p\") pod \"ingress-canary-kc5n4\" (UID: \"7a0189c0-e01f-4b0c-94db-a61478aac890\") " pod="openshift-ingress-canary/ingress-canary-kc5n4" Jul 28 16:36:30.046429 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.046302 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkthz\" (UniqueName: \"kubernetes.io/projected/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-kube-api-access-nkthz\") pod \"dns-default-dk8k8\" (UID: \"c33d7eac-0a52-4dd3-ac04-8270ea27bb01\") " pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:30.046429 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.046331 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-tmp-dir\") pod \"dns-default-dk8k8\" (UID: \"c33d7eac-0a52-4dd3-ac04-8270ea27bb01\") " pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:30.046429 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.046348 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a0189c0-e01f-4b0c-94db-a61478aac890-cert\") pod \"ingress-canary-kc5n4\" (UID: \"7a0189c0-e01f-4b0c-94db-a61478aac890\") " pod="openshift-ingress-canary/ingress-canary-kc5n4" Jul 28 16:36:30.046429 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.046368 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-config-volume\") pod \"dns-default-dk8k8\" (UID: \"c33d7eac-0a52-4dd3-ac04-8270ea27bb01\") " pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:30.046429 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.046403 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls\") pod \"dns-default-dk8k8\" (UID: \"c33d7eac-0a52-4dd3-ac04-8270ea27bb01\") " pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:30.046631 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:30.046503 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:36:30.046631 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:30.046572 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls podName:c33d7eac-0a52-4dd3-ac04-8270ea27bb01 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:30.546549201 +0000 UTC m=+36.026097774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls") pod "dns-default-dk8k8" (UID: "c33d7eac-0a52-4dd3-ac04-8270ea27bb01") : secret "dns-default-metrics-tls" not found Jul 28 16:36:30.046775 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.046755 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-tmp-dir\") pod \"dns-default-dk8k8\" (UID: \"c33d7eac-0a52-4dd3-ac04-8270ea27bb01\") " pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:30.047073 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.047051 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-config-volume\") pod \"dns-default-dk8k8\" (UID: \"c33d7eac-0a52-4dd3-ac04-8270ea27bb01\") " pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:30.047230 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.047215 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:36:30.047260 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.047238 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:36:30.047260 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.047240 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:36:30.049619 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.049599 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9n9cd\"" Jul 28 16:36:30.049619 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.049609 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 16:36:30.049619 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.049599 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 16:36:30.049925 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.049735 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 16:36:30.050006 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.049991 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nw5rm\"" Jul 28 16:36:30.050143 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.050130 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 16:36:30.056720 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.056684 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkthz\" (UniqueName: \"kubernetes.io/projected/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-kube-api-access-nkthz\") pod \"dns-default-dk8k8\" (UID: \"c33d7eac-0a52-4dd3-ac04-8270ea27bb01\") " pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:30.146726 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.146681 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a0189c0-e01f-4b0c-94db-a61478aac890-cert\") pod \"ingress-canary-kc5n4\" (UID: \"7a0189c0-e01f-4b0c-94db-a61478aac890\") " pod="openshift-ingress-canary/ingress-canary-kc5n4" Jul 28 16:36:30.146859 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.146792 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th22p\" (UniqueName: \"kubernetes.io/projected/7a0189c0-e01f-4b0c-94db-a61478aac890-kube-api-access-th22p\") pod \"ingress-canary-kc5n4\" (UID: \"7a0189c0-e01f-4b0c-94db-a61478aac890\") " pod="openshift-ingress-canary/ingress-canary-kc5n4" Jul 28 16:36:30.149136 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.149114 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a0189c0-e01f-4b0c-94db-a61478aac890-cert\") pod \"ingress-canary-kc5n4\" (UID: \"7a0189c0-e01f-4b0c-94db-a61478aac890\") " pod="openshift-ingress-canary/ingress-canary-kc5n4" Jul 28 16:36:30.154471 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.154445 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th22p\" (UniqueName: \"kubernetes.io/projected/7a0189c0-e01f-4b0c-94db-a61478aac890-kube-api-access-th22p\") pod \"ingress-canary-kc5n4\" (UID: \"7a0189c0-e01f-4b0c-94db-a61478aac890\") " pod="openshift-ingress-canary/ingress-canary-kc5n4" Jul 28 16:36:30.193929 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.193906 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kc5n4" Jul 28 16:36:30.230119 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.230086 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-77cw2" event={"ID":"161c4091-677f-4218-8594-cbe3d29004c7","Type":"ContainerStarted","Data":"c45f360b2871ff01365b9d49889cacda44753694de06f349999b06ddb128a74a"} Jul 28 16:36:30.390085 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.389915 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kc5n4"] Jul 28 16:36:30.393769 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:36:30.393740 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a0189c0_e01f_4b0c_94db_a61478aac890.slice/crio-c30163c466549a2e0002cb319bba9e284e13416e74fc808e253d33571fc14ea8 WatchSource:0}: Error finding container c30163c466549a2e0002cb319bba9e284e13416e74fc808e253d33571fc14ea8: Status 404 returned error can't find the container with id c30163c466549a2e0002cb319bba9e284e13416e74fc808e253d33571fc14ea8 Jul 28 16:36:30.550151 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:30.550109 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls\") pod \"dns-default-dk8k8\" (UID: \"c33d7eac-0a52-4dd3-ac04-8270ea27bb01\") " pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:30.550316 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:30.550225 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:36:30.550316 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:30.550291 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls podName:c33d7eac-0a52-4dd3-ac04-8270ea27bb01 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:31.55027213 +0000 UTC m=+37.029820711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls") pod "dns-default-dk8k8" (UID: "c33d7eac-0a52-4dd3-ac04-8270ea27bb01") : secret "dns-default-metrics-tls" not found Jul 28 16:36:31.234090 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:31.234049 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kc5n4" event={"ID":"7a0189c0-e01f-4b0c-94db-a61478aac890","Type":"ContainerStarted","Data":"c30163c466549a2e0002cb319bba9e284e13416e74fc808e253d33571fc14ea8"} Jul 28 16:36:31.237112 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:31.237087 2570 generic.go:356] "Generic (PLEG): container finished" podID="161c4091-677f-4218-8594-cbe3d29004c7" containerID="c45f360b2871ff01365b9d49889cacda44753694de06f349999b06ddb128a74a" exitCode=0 Jul 28 16:36:31.237235 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:31.237140 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-77cw2" event={"ID":"161c4091-677f-4218-8594-cbe3d29004c7","Type":"ContainerDied","Data":"c45f360b2871ff01365b9d49889cacda44753694de06f349999b06ddb128a74a"} Jul 28 16:36:31.558035 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:31.557994 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls\") pod \"dns-default-dk8k8\" (UID: \"c33d7eac-0a52-4dd3-ac04-8270ea27bb01\") " pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:31.558214 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:31.558144 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:36:31.558214 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:31.558212 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls podName:c33d7eac-0a52-4dd3-ac04-8270ea27bb01 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:33.55819268 +0000 UTC m=+39.037741254 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls") pod "dns-default-dk8k8" (UID: "c33d7eac-0a52-4dd3-ac04-8270ea27bb01") : secret "dns-default-metrics-tls" not found Jul 28 16:36:32.243140 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:32.243107 2570 generic.go:356] "Generic (PLEG): container finished" podID="161c4091-677f-4218-8594-cbe3d29004c7" containerID="49b4fc90fd7e681851ffe019e77d7d27a72759fd61bdb926662340e8d4091494" exitCode=0 Jul 28 16:36:32.243539 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:32.243160 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-77cw2" event={"ID":"161c4091-677f-4218-8594-cbe3d29004c7","Type":"ContainerDied","Data":"49b4fc90fd7e681851ffe019e77d7d27a72759fd61bdb926662340e8d4091494"} Jul 28 16:36:33.250292 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:33.250204 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kc5n4" event={"ID":"7a0189c0-e01f-4b0c-94db-a61478aac890","Type":"ContainerStarted","Data":"ac33bc3b12ac402c1140fbc7d0d0fad851f3349baa63461132434924f77d16f7"} Jul 28 16:36:33.253554 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:33.253518 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-77cw2" event={"ID":"161c4091-677f-4218-8594-cbe3d29004c7","Type":"ContainerStarted","Data":"7adf36244d829924b3b08f1d59ad43a7b06c2002357945312a2048cc130ba0bd"} Jul 28 16:36:33.266783 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:33.266742 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kc5n4" podStartSLOduration=1.752093932 podStartE2EDuration="4.266727717s" totalImagesPullingTime="2.514633785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:33.266087969 +0000 UTC m=+38.745636563" watchObservedRunningTime="2026-07-28 16:36:33.266727717 +0000 UTC m=+38.746276290" Jul 28 16:36:33.573776 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:33.573741 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls\") pod \"dns-default-dk8k8\" (UID: \"c33d7eac-0a52-4dd3-ac04-8270ea27bb01\") " pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:33.573946 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:33.573874 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:36:33.573946 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:33.573928 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls podName:c33d7eac-0a52-4dd3-ac04-8270ea27bb01 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:37.573914389 +0000 UTC m=+43.053462961 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls") pod "dns-default-dk8k8" (UID: "c33d7eac-0a52-4dd3-ac04-8270ea27bb01") : secret "dns-default-metrics-tls" not found Jul 28 16:36:34.146513 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.146310 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-77cw2" podStartSLOduration=10.580661778 podStartE2EDuration="39.14629115s" totalImagesPullingTime="28.565629372s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:33.290378488 +0000 UTC m=+38.769927098" watchObservedRunningTime="2026-07-28 16:36:34.14629115 +0000 UTC m=+39.625839797" Jul 28 16:36:34.146892 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.146876 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-62qjc"] Jul 28 16:36:34.168444 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.168420 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-62qjc"] Jul 28 16:36:34.168562 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.168538 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:34.170671 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.170653 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 16:36:34.170833 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.170815 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 16:36:34.170878 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.170832 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 16:36:34.170913 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.170880 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 16:36:34.171639 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.171625 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2fqqs\"" Jul 28 16:36:34.279644 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.279613 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:34.280011 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.279658 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-data-volume\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:34.280011 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.279715 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:34.280011 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.279753 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-crio-socket\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:34.280011 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.279792 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jnbf\" (UniqueName: \"kubernetes.io/projected/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-api-access-8jnbf\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:34.380843 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.380809 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:34.381030 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.380849 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-crio-socket\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:34.381030 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:34.380938 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 16:36:34.381030 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:34.381006 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-rbac-proxy-cm podName:9cd2b93f-c34f-460a-b55d-fdeebd7def4e nodeName:}" failed. No retries permitted until 2026-07-28 16:36:34.88099098 +0000 UTC m=+40.360539551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-62qjc" (UID: "9cd2b93f-c34f-460a-b55d-fdeebd7def4e") : configmap "kube-rbac-proxy" not found Jul 28 16:36:34.381030 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.381023 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jnbf\" (UniqueName: \"kubernetes.io/projected/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-api-access-8jnbf\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:34.381220 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.381058 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-crio-socket\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:34.381220 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.381203 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:34.381295 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.381258 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-data-volume\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:34.381336 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:34.381316 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 16:36:34.381390 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:34.381377 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls podName:9cd2b93f-c34f-460a-b55d-fdeebd7def4e nodeName:}" failed. No retries permitted until 2026-07-28 16:36:34.881356858 +0000 UTC m=+40.360905433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-62qjc" (UID: "9cd2b93f-c34f-460a-b55d-fdeebd7def4e") : secret "insights-runtime-extractor-tls" not found Jul 28 16:36:34.381602 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.381585 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-data-volume\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:34.399998 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.399912 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jnbf\" (UniqueName: \"kubernetes.io/projected/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-api-access-8jnbf\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:34.407626 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.407603 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-pd2tg"] Jul 28 16:36:34.427831 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.427811 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-pd2tg"] Jul 28 16:36:34.427933 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.427904 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pd2tg" Jul 28 16:36:34.430207 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.430184 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8t8jp\"" Jul 28 16:36:34.430207 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.430198 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 28 16:36:34.430346 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.430311 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 28 16:36:34.583124 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.583087 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nps85\" (UniqueName: \"kubernetes.io/projected/f9df04a4-e9eb-455e-ba58-36045c0e5b00-kube-api-access-nps85\") pod \"migrator-6865c9967-pd2tg\" (UID: \"f9df04a4-e9eb-455e-ba58-36045c0e5b00\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pd2tg" Jul 28 16:36:34.684497 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.684417 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nps85\" (UniqueName: \"kubernetes.io/projected/f9df04a4-e9eb-455e-ba58-36045c0e5b00-kube-api-access-nps85\") pod \"migrator-6865c9967-pd2tg\" (UID: \"f9df04a4-e9eb-455e-ba58-36045c0e5b00\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pd2tg" Jul 28 16:36:34.693528 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.693503 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nps85\" (UniqueName: \"kubernetes.io/projected/f9df04a4-e9eb-455e-ba58-36045c0e5b00-kube-api-access-nps85\") pod \"migrator-6865c9967-pd2tg\" (UID: \"f9df04a4-e9eb-455e-ba58-36045c0e5b00\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pd2tg" Jul 28 16:36:34.736486 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.736453 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pd2tg" Jul 28 16:36:34.886834 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.886802 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:34.886978 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.886900 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:34.886978 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:34.886921 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 16:36:34.887045 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:34.886992 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-rbac-proxy-cm podName:9cd2b93f-c34f-460a-b55d-fdeebd7def4e nodeName:}" failed. No retries permitted until 2026-07-28 16:36:35.886971478 +0000 UTC m=+41.366520077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-62qjc" (UID: "9cd2b93f-c34f-460a-b55d-fdeebd7def4e") : configmap "kube-rbac-proxy" not found Jul 28 16:36:34.887045 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:34.887019 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 16:36:34.887108 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:34.887060 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls podName:9cd2b93f-c34f-460a-b55d-fdeebd7def4e nodeName:}" failed. No retries permitted until 2026-07-28 16:36:35.88704879 +0000 UTC m=+41.366597372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-62qjc" (UID: "9cd2b93f-c34f-460a-b55d-fdeebd7def4e") : secret "insights-runtime-extractor-tls" not found Jul 28 16:36:34.894507 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:34.894478 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-pd2tg"] Jul 28 16:36:34.897559 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:36:34.897532 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9df04a4_e9eb_455e_ba58_36045c0e5b00.slice/crio-a18c66deaa5e4d33bf6f411b19c9546104ccd0f8452a9d0fdc9a44b0f8be8b8e WatchSource:0}: Error finding container a18c66deaa5e4d33bf6f411b19c9546104ccd0f8452a9d0fdc9a44b0f8be8b8e: Status 404 returned error can't find the container with id a18c66deaa5e4d33bf6f411b19c9546104ccd0f8452a9d0fdc9a44b0f8be8b8e Jul 28 16:36:35.258409 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:35.258373 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pd2tg" event={"ID":"f9df04a4-e9eb-455e-ba58-36045c0e5b00","Type":"ContainerStarted","Data":"a18c66deaa5e4d33bf6f411b19c9546104ccd0f8452a9d0fdc9a44b0f8be8b8e"} Jul 28 16:36:35.893578 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:35.893534 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:35.894362 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:35.893614 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:35.894362 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:35.893712 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 16:36:35.894362 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:35.893739 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 16:36:35.894362 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:35.893797 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls podName:9cd2b93f-c34f-460a-b55d-fdeebd7def4e nodeName:}" failed. No retries permitted until 2026-07-28 16:36:37.893773387 +0000 UTC m=+43.373321959 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-62qjc" (UID: "9cd2b93f-c34f-460a-b55d-fdeebd7def4e") : secret "insights-runtime-extractor-tls" not found Jul 28 16:36:35.894362 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:35.893818 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-rbac-proxy-cm podName:9cd2b93f-c34f-460a-b55d-fdeebd7def4e nodeName:}" failed. No retries permitted until 2026-07-28 16:36:37.893810198 +0000 UTC m=+43.373358771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-62qjc" (UID: "9cd2b93f-c34f-460a-b55d-fdeebd7def4e") : configmap "kube-rbac-proxy" not found Jul 28 16:36:35.932241 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:35.932214 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4ztpj_750f3037-9908-4415-9550-90fc8f863882/dns-node-resolver/0.log" Jul 28 16:36:36.935838 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:36.935817 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2bvtp_99b4a0dc-9c95-4215-8c0c-2e18b9442836/node-ca/0.log" Jul 28 16:36:37.264921 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:37.264888 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pd2tg" event={"ID":"f9df04a4-e9eb-455e-ba58-36045c0e5b00","Type":"ContainerStarted","Data":"444bbe29cd33aa0a68045684087080c139632f50a92437c4b1f48389c1784055"} Jul 28 16:36:37.265084 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:37.264949 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pd2tg" event={"ID":"f9df04a4-e9eb-455e-ba58-36045c0e5b00","Type":"ContainerStarted","Data":"7bce161ecbf30e09a7a18c5ff22038f3edf2daa6605ff921d8918a3bf92075c3"} Jul 28 16:36:37.605808 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:37.605759 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls\") pod \"dns-default-dk8k8\" (UID: \"c33d7eac-0a52-4dd3-ac04-8270ea27bb01\") " pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:37.606006 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:37.605930 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:36:37.606072 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:37.606012 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls podName:c33d7eac-0a52-4dd3-ac04-8270ea27bb01 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:45.60598836 +0000 UTC m=+51.085536950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls") pod "dns-default-dk8k8" (UID: "c33d7eac-0a52-4dd3-ac04-8270ea27bb01") : secret "dns-default-metrics-tls" not found Jul 28 16:36:37.732509 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:37.732476 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kc5n4_7a0189c0-e01f-4b0c-94db-a61478aac890/serve-healthcheck-canary/0.log" Jul 28 16:36:37.908904 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:37.908824 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:37.908904 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:37.908883 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:37.909075 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:37.908983 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 16:36:37.909075 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:37.908985 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 16:36:37.909075 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:37.909035 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-rbac-proxy-cm podName:9cd2b93f-c34f-460a-b55d-fdeebd7def4e nodeName:}" failed. No retries permitted until 2026-07-28 16:36:41.909021232 +0000 UTC m=+47.388569803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-62qjc" (UID: "9cd2b93f-c34f-460a-b55d-fdeebd7def4e") : configmap "kube-rbac-proxy" not found Jul 28 16:36:37.909075 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:37.909047 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls podName:9cd2b93f-c34f-460a-b55d-fdeebd7def4e nodeName:}" failed. No retries permitted until 2026-07-28 16:36:41.909041525 +0000 UTC m=+47.388590097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-62qjc" (UID: "9cd2b93f-c34f-460a-b55d-fdeebd7def4e") : secret "insights-runtime-extractor-tls" not found Jul 28 16:36:41.938437 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:41.938388 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:41.938937 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:41.938458 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:41.938937 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:41.938549 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 16:36:41.938937 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:36:41.938614 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls podName:9cd2b93f-c34f-460a-b55d-fdeebd7def4e nodeName:}" failed. No retries permitted until 2026-07-28 16:36:49.938598046 +0000 UTC m=+55.418146617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-62qjc" (UID: "9cd2b93f-c34f-460a-b55d-fdeebd7def4e") : secret "insights-runtime-extractor-tls" not found Jul 28 16:36:41.939049 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:41.938994 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:45.664331 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:45.664296 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls\") pod \"dns-default-dk8k8\" (UID: \"c33d7eac-0a52-4dd3-ac04-8270ea27bb01\") " pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:45.666700 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:45.666659 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c33d7eac-0a52-4dd3-ac04-8270ea27bb01-metrics-tls\") pod \"dns-default-dk8k8\" (UID: \"c33d7eac-0a52-4dd3-ac04-8270ea27bb01\") " pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:45.787119 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:45.787076 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:45.936017 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:45.935909 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pd2tg" podStartSLOduration=10.131066055 podStartE2EDuration="11.935892136s" totalImagesPullingTime="1.804826081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:37.282224572 +0000 UTC m=+42.761773175" watchObservedRunningTime="2026-07-28 16:36:45.935892136 +0000 UTC m=+51.415440730" Jul 28 16:36:45.936871 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:45.936837 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dk8k8"] Jul 28 16:36:45.939793 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:36:45.939763 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc33d7eac_0a52_4dd3_ac04_8270ea27bb01.slice/crio-57f24b6792240783f6572c283875ef48aab81e1149868da38955b18c61b23fa7 WatchSource:0}: Error finding container 57f24b6792240783f6572c283875ef48aab81e1149868da38955b18c61b23fa7: Status 404 returned error can't find the container with id 57f24b6792240783f6572c283875ef48aab81e1149868da38955b18c61b23fa7 Jul 28 16:36:46.287174 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:46.287138 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dk8k8" event={"ID":"c33d7eac-0a52-4dd3-ac04-8270ea27bb01","Type":"ContainerStarted","Data":"57f24b6792240783f6572c283875ef48aab81e1149868da38955b18c61b23fa7"} Jul 28 16:36:48.294345 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:48.294319 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dk8k8" event={"ID":"c33d7eac-0a52-4dd3-ac04-8270ea27bb01","Type":"ContainerStarted","Data":"eb8868701de645ceb71f7a5df13f868e0cc906d1ae3ac2b874cc7e90b5a8d6ad"} Jul 28 16:36:49.297745 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:49.297707 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dk8k8" event={"ID":"c33d7eac-0a52-4dd3-ac04-8270ea27bb01","Type":"ContainerStarted","Data":"bd338b364f5b210569911e6f20cd94f7b095c9c0325792afd40a7fdced062ec9"} Jul 28 16:36:49.298156 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:49.297861 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:49.316948 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:49.316894 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dk8k8" podStartSLOduration=18.107512809 podStartE2EDuration="20.316877509s" totalImagesPullingTime="2.2093647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:49.315539577 +0000 UTC m=+54.795088171" watchObservedRunningTime="2026-07-28 16:36:49.316877509 +0000 UTC m=+54.796426103" Jul 28 16:36:49.998649 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:49.998618 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:50.001020 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:50.000994 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cd2b93f-c34f-460a-b55d-fdeebd7def4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62qjc\" (UID: \"9cd2b93f-c34f-460a-b55d-fdeebd7def4e\") " pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:50.078099 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:50.078061 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-62qjc" Jul 28 16:36:50.208293 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:50.208265 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-62qjc"] Jul 28 16:36:50.211532 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:36:50.211500 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd2b93f_c34f_460a_b55d_fdeebd7def4e.slice/crio-324f6a4fdb749c529c348cd7a2808e40acf20a085c187511989502f2b10b5356 WatchSource:0}: Error finding container 324f6a4fdb749c529c348cd7a2808e40acf20a085c187511989502f2b10b5356: Status 404 returned error can't find the container with id 324f6a4fdb749c529c348cd7a2808e40acf20a085c187511989502f2b10b5356 Jul 28 16:36:50.304503 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:50.304472 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-62qjc" event={"ID":"9cd2b93f-c34f-460a-b55d-fdeebd7def4e","Type":"ContainerStarted","Data":"324f6a4fdb749c529c348cd7a2808e40acf20a085c187511989502f2b10b5356"} Jul 28 16:36:56.229759 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:56.229292 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rc9g" Jul 28 16:36:56.324031 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:56.323990 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-62qjc" event={"ID":"9cd2b93f-c34f-460a-b55d-fdeebd7def4e","Type":"ContainerStarted","Data":"1b1cf62ae152939866903ba37ff841f99025f0c59afc694c5af5658503d6898b"} Jul 28 16:36:59.307105 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:59.307072 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dk8k8" Jul 28 16:36:59.336331 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:36:59.336298 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-62qjc" event={"ID":"9cd2b93f-c34f-460a-b55d-fdeebd7def4e","Type":"ContainerStarted","Data":"796dab7dbb5f4c74d00caa78d9adda6ed7a44f66382e29aac734dcf7d57431b4"} Jul 28 16:37:00.286829 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.286794 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-8v2kh"] Jul 28 16:37:00.308384 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.308347 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669767ff94-sjndv"] Jul 28 16:37:00.308832 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.308475 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-8v2kh" Jul 28 16:37:00.311469 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.311280 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lk2gg\"" Jul 28 16:37:00.312468 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.312445 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 28 16:37:00.312776 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.312762 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 28 16:37:00.330465 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.330438 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669767ff94-sjndv" Jul 28 16:37:00.330793 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.330445 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669767ff94-sjndv"] Jul 28 16:37:00.330885 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.330822 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-8v2kh"] Jul 28 16:37:00.332907 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.332853 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 16:37:00.332907 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.332901 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-blrkr\"" Jul 28 16:37:00.333103 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.333038 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 16:37:00.333477 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.333332 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 28 16:37:00.334033 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.334014 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 16:37:00.374555 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.374526 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/25ea5499-daf3-488a-8c11-cbd3af4c2587-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-8v2kh\" (UID: \"25ea5499-daf3-488a-8c11-cbd3af4c2587\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-8v2kh" Jul 28 16:37:00.374708 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.374564 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75e36d2c-b848-4ee9-8cce-069629513fe0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-669767ff94-sjndv\" (UID: \"75e36d2c-b848-4ee9-8cce-069629513fe0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669767ff94-sjndv" Jul 28 16:37:00.374708 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.374648 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xdxw\" (UniqueName: \"kubernetes.io/projected/75e36d2c-b848-4ee9-8cce-069629513fe0-kube-api-access-8xdxw\") pod \"managed-serviceaccount-addon-agent-669767ff94-sjndv\" (UID: \"75e36d2c-b848-4ee9-8cce-069629513fe0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669767ff94-sjndv" Jul 28 16:37:00.374790 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.374713 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/25ea5499-daf3-488a-8c11-cbd3af4c2587-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-8v2kh\" (UID: \"25ea5499-daf3-488a-8c11-cbd3af4c2587\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-8v2kh" Jul 28 16:37:00.392037 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.391998 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67c6854748-sf82n"] Jul 28 16:37:00.404823 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.404798 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.408242 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.408224 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 16:37:00.408341 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.408248 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 16:37:00.408341 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.408295 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 16:37:00.408518 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.408505 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rnw5h\"" Jul 28 16:37:00.418717 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.418679 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67c6854748-sf82n"] Jul 28 16:37:00.424431 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.424407 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 16:37:00.475814 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.475768 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/25ea5499-daf3-488a-8c11-cbd3af4c2587-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-8v2kh\" (UID: \"25ea5499-daf3-488a-8c11-cbd3af4c2587\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-8v2kh" Jul 28 16:37:00.476006 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.475835 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/411b1dbf-5e94-48d6-9f24-8845319a37f3-image-registry-private-configuration\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.476006 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.475883 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/411b1dbf-5e94-48d6-9f24-8845319a37f3-trusted-ca\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.476006 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.475905 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/411b1dbf-5e94-48d6-9f24-8845319a37f3-bound-sa-token\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.476006 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.475979 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/411b1dbf-5e94-48d6-9f24-8845319a37f3-installation-pull-secrets\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.476244 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.476057 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/25ea5499-daf3-488a-8c11-cbd3af4c2587-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-8v2kh\" (UID: \"25ea5499-daf3-488a-8c11-cbd3af4c2587\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-8v2kh" Jul 28 16:37:00.476244 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.476102 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75e36d2c-b848-4ee9-8cce-069629513fe0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-669767ff94-sjndv\" (UID: \"75e36d2c-b848-4ee9-8cce-069629513fe0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669767ff94-sjndv" Jul 28 16:37:00.476244 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.476145 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k7wp\" (UniqueName: \"kubernetes.io/projected/411b1dbf-5e94-48d6-9f24-8845319a37f3-kube-api-access-7k7wp\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.476244 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.476185 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/411b1dbf-5e94-48d6-9f24-8845319a37f3-registry-tls\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.476244 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.476208 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/411b1dbf-5e94-48d6-9f24-8845319a37f3-registry-certificates\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.476500 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.476269 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xdxw\" (UniqueName: \"kubernetes.io/projected/75e36d2c-b848-4ee9-8cce-069629513fe0-kube-api-access-8xdxw\") pod \"managed-serviceaccount-addon-agent-669767ff94-sjndv\" (UID: \"75e36d2c-b848-4ee9-8cce-069629513fe0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669767ff94-sjndv" Jul 28 16:37:00.476500 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.476298 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/411b1dbf-5e94-48d6-9f24-8845319a37f3-ca-trust-extracted\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.476708 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.476674 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/25ea5499-daf3-488a-8c11-cbd3af4c2587-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-8v2kh\" (UID: \"25ea5499-daf3-488a-8c11-cbd3af4c2587\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-8v2kh" Jul 28 16:37:00.479495 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.479470 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/25ea5499-daf3-488a-8c11-cbd3af4c2587-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-8v2kh\" (UID: \"25ea5499-daf3-488a-8c11-cbd3af4c2587\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-8v2kh" Jul 28 16:37:00.479848 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.479823 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75e36d2c-b848-4ee9-8cce-069629513fe0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-669767ff94-sjndv\" (UID: \"75e36d2c-b848-4ee9-8cce-069629513fe0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669767ff94-sjndv" Jul 28 16:37:00.491996 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.491970 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xdxw\" (UniqueName: \"kubernetes.io/projected/75e36d2c-b848-4ee9-8cce-069629513fe0-kube-api-access-8xdxw\") pod \"managed-serviceaccount-addon-agent-669767ff94-sjndv\" (UID: \"75e36d2c-b848-4ee9-8cce-069629513fe0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669767ff94-sjndv" Jul 28 16:37:00.577248 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.577148 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k7wp\" (UniqueName: \"kubernetes.io/projected/411b1dbf-5e94-48d6-9f24-8845319a37f3-kube-api-access-7k7wp\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.577248 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.577211 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/411b1dbf-5e94-48d6-9f24-8845319a37f3-registry-tls\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.577248 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.577238 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/411b1dbf-5e94-48d6-9f24-8845319a37f3-registry-certificates\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.577520 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.577266 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/411b1dbf-5e94-48d6-9f24-8845319a37f3-ca-trust-extracted\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.577520 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.577452 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/411b1dbf-5e94-48d6-9f24-8845319a37f3-image-registry-private-configuration\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.577520 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.577501 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/411b1dbf-5e94-48d6-9f24-8845319a37f3-trusted-ca\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.577676 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.577619 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/411b1dbf-5e94-48d6-9f24-8845319a37f3-bound-sa-token\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.577765 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.577683 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/411b1dbf-5e94-48d6-9f24-8845319a37f3-installation-pull-secrets\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.577829 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.577804 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/411b1dbf-5e94-48d6-9f24-8845319a37f3-ca-trust-extracted\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.578170 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.578126 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/411b1dbf-5e94-48d6-9f24-8845319a37f3-registry-certificates\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.578590 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.578545 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/411b1dbf-5e94-48d6-9f24-8845319a37f3-trusted-ca\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.580255 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.580231 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/411b1dbf-5e94-48d6-9f24-8845319a37f3-registry-tls\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.580402 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.580386 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/411b1dbf-5e94-48d6-9f24-8845319a37f3-image-registry-private-configuration\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.580548 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.580529 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/411b1dbf-5e94-48d6-9f24-8845319a37f3-installation-pull-secrets\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.586598 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.586579 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k7wp\" (UniqueName: \"kubernetes.io/projected/411b1dbf-5e94-48d6-9f24-8845319a37f3-kube-api-access-7k7wp\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.586746 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.586619 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/411b1dbf-5e94-48d6-9f24-8845319a37f3-bound-sa-token\") pod \"image-registry-67c6854748-sf82n\" (UID: \"411b1dbf-5e94-48d6-9f24-8845319a37f3\") " pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.619835 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.619804 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-8v2kh" Jul 28 16:37:00.648597 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.648568 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669767ff94-sjndv" Jul 28 16:37:00.678661 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.678630 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rn4q\" (UniqueName: \"kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q\") pod \"network-check-target-ghkxh\" (UID: \"a34f5490-8d32-4aba-808d-5d9a2b0b65e6\") " pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:37:00.678825 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.678701 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret\") pod \"global-pull-secret-syncer-qfctx\" (UID: \"c8b7d602-7f06-4c32-85e7-fd711dcf48ef\") " pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:37:00.678825 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.678751 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs\") pod \"network-metrics-daemon-rk2lg\" (UID: \"43046d78-bb7a-40ab-9e3e-d2d901471738\") " pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:37:00.681463 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.681429 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 16:37:00.681584 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.681435 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 16:37:00.681584 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.681482 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 16:37:00.691487 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.691404 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 16:37:00.691640 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.691618 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8b7d602-7f06-4c32-85e7-fd711dcf48ef-original-pull-secret\") pod \"global-pull-secret-syncer-qfctx\" (UID: \"c8b7d602-7f06-4c32-85e7-fd711dcf48ef\") " pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:37:00.691784 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.691768 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43046d78-bb7a-40ab-9e3e-d2d901471738-metrics-certs\") pod \"network-metrics-daemon-rk2lg\" (UID: \"43046d78-bb7a-40ab-9e3e-d2d901471738\") " pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:37:00.702476 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.702452 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rn4q\" (UniqueName: \"kubernetes.io/projected/a34f5490-8d32-4aba-808d-5d9a2b0b65e6-kube-api-access-8rn4q\") pod \"network-check-target-ghkxh\" (UID: \"a34f5490-8d32-4aba-808d-5d9a2b0b65e6\") " pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:37:00.713616 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.713597 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:00.960457 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.960375 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nw5rm\"" Jul 28 16:37:00.966991 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.966963 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk2lg" Jul 28 16:37:00.969397 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.969373 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9n9cd\"" Jul 28 16:37:00.971420 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.971398 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfctx" Jul 28 16:37:00.977527 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:00.977508 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:37:02.348310 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:02.348225 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-62qjc" event={"ID":"9cd2b93f-c34f-460a-b55d-fdeebd7def4e","Type":"ContainerStarted","Data":"05ab4fc999e5f2de45a5f62fb02d6e2ab36e43795c67759916980e8b4591c9c7"} Jul 28 16:37:02.367941 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:02.367892 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-62qjc" podStartSLOduration=16.572882141 podStartE2EDuration="28.367872448s" totalImagesPullingTime="11.794990307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:36:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:02.366828723 +0000 UTC m=+67.846377319" watchObservedRunningTime="2026-07-28 16:37:02.367872448 +0000 UTC m=+67.847421042" Jul 28 16:37:02.482149 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:02.482126 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-8v2kh"] Jul 28 16:37:02.484719 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:37:02.484675 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ea5499_daf3_488a_8c11_cbd3af4c2587.slice/crio-7cf1859ff59566a2a02207613c8c9266945f2e6c444d45be99190e8b14d4082d WatchSource:0}: Error finding container 7cf1859ff59566a2a02207613c8c9266945f2e6c444d45be99190e8b14d4082d: Status 404 returned error can't find the container with id 7cf1859ff59566a2a02207613c8c9266945f2e6c444d45be99190e8b14d4082d Jul 28 16:37:02.485813 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:02.485747 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rk2lg"] Jul 28 16:37:02.488217 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:37:02.488085 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43046d78_bb7a_40ab_9e3e_d2d901471738.slice/crio-209eb7323316e7f66d433a5a222458b08a7fff8feba4c1c5f3b2a323c15b362c WatchSource:0}: Error finding container 209eb7323316e7f66d433a5a222458b08a7fff8feba4c1c5f3b2a323c15b362c: Status 404 returned error can't find the container with id 209eb7323316e7f66d433a5a222458b08a7fff8feba4c1c5f3b2a323c15b362c Jul 28 16:37:02.488453 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:02.488431 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qfctx"] Jul 28 16:37:02.492384 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:37:02.492330 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b7d602_7f06_4c32_85e7_fd711dcf48ef.slice/crio-9f0a89283f247c653a62d7a15ba58facb1219d018ce6c5176d876ea29f4763bf WatchSource:0}: Error finding container 9f0a89283f247c653a62d7a15ba58facb1219d018ce6c5176d876ea29f4763bf: Status 404 returned error can't find the container with id 9f0a89283f247c653a62d7a15ba58facb1219d018ce6c5176d876ea29f4763bf Jul 28 16:37:02.522248 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:02.522221 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669767ff94-sjndv"] Jul 28 16:37:02.523713 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:02.523639 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ghkxh"] Jul 28 16:37:02.525644 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:37:02.525622 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75e36d2c_b848_4ee9_8cce_069629513fe0.slice/crio-5984010cf4898e1e7e565b3960b8967376e09d5fdd56ba6a045d258ee0258e74 WatchSource:0}: Error finding container 5984010cf4898e1e7e565b3960b8967376e09d5fdd56ba6a045d258ee0258e74: Status 404 returned error can't find the container with id 5984010cf4898e1e7e565b3960b8967376e09d5fdd56ba6a045d258ee0258e74 Jul 28 16:37:02.526450 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:37:02.526420 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda34f5490_8d32_4aba_808d_5d9a2b0b65e6.slice/crio-ecd537acddf21ead6387c24b20a7f01141ca396ec95d3c0fbdaf020d896bed9e WatchSource:0}: Error finding container ecd537acddf21ead6387c24b20a7f01141ca396ec95d3c0fbdaf020d896bed9e: Status 404 returned error can't find the container with id ecd537acddf21ead6387c24b20a7f01141ca396ec95d3c0fbdaf020d896bed9e Jul 28 16:37:02.528746 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:02.528671 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67c6854748-sf82n"] Jul 28 16:37:02.530345 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:37:02.530309 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod411b1dbf_5e94_48d6_9f24_8845319a37f3.slice/crio-fe09b01f635cc118443e56c6e2fc53fd23c75c2b0179b9195263c36f6da7aa50 WatchSource:0}: Error finding container fe09b01f635cc118443e56c6e2fc53fd23c75c2b0179b9195263c36f6da7aa50: Status 404 returned error can't find the container with id fe09b01f635cc118443e56c6e2fc53fd23c75c2b0179b9195263c36f6da7aa50 Jul 28 16:37:03.027936 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.026826 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xpkdj"] Jul 28 16:37:03.029915 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.029779 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xpkdj" Jul 28 16:37:03.032285 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.032260 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 28 16:37:03.033290 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.032568 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xn2w4\"" Jul 28 16:37:03.039536 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.038219 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xpkdj"] Jul 28 16:37:03.095380 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.095344 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c4266acf-af05-4015-a11d-2b6686427299-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xpkdj\" (UID: \"c4266acf-af05-4015-a11d-2b6686427299\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xpkdj" Jul 28 16:37:03.196303 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.196262 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c4266acf-af05-4015-a11d-2b6686427299-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xpkdj\" (UID: \"c4266acf-af05-4015-a11d-2b6686427299\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xpkdj" Jul 28 16:37:03.196496 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:37:03.196429 2570 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 28 16:37:03.196567 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:37:03.196516 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4266acf-af05-4015-a11d-2b6686427299-tls-certificates podName:c4266acf-af05-4015-a11d-2b6686427299 nodeName:}" failed. No retries permitted until 2026-07-28 16:37:03.696493151 +0000 UTC m=+69.176041725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/c4266acf-af05-4015-a11d-2b6686427299-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-xpkdj" (UID: "c4266acf-af05-4015-a11d-2b6686427299") : secret "prometheus-operator-admission-webhook-tls" not found Jul 28 16:37:03.354035 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.353951 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-8v2kh" event={"ID":"25ea5499-daf3-488a-8c11-cbd3af4c2587","Type":"ContainerStarted","Data":"7cf1859ff59566a2a02207613c8c9266945f2e6c444d45be99190e8b14d4082d"} Jul 28 16:37:03.356392 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.356069 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67c6854748-sf82n" event={"ID":"411b1dbf-5e94-48d6-9f24-8845319a37f3","Type":"ContainerStarted","Data":"6a4dbf6ca9c9d24e2390a3a84e3a6a417b6cfdabe8156c9ad98eea2ec43cee63"} Jul 28 16:37:03.356392 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.356120 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67c6854748-sf82n" event={"ID":"411b1dbf-5e94-48d6-9f24-8845319a37f3","Type":"ContainerStarted","Data":"fe09b01f635cc118443e56c6e2fc53fd23c75c2b0179b9195263c36f6da7aa50"} Jul 28 16:37:03.356392 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.356327 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:03.358321 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.358255 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ghkxh" event={"ID":"a34f5490-8d32-4aba-808d-5d9a2b0b65e6","Type":"ContainerStarted","Data":"ecd537acddf21ead6387c24b20a7f01141ca396ec95d3c0fbdaf020d896bed9e"} Jul 28 16:37:03.360296 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.360269 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669767ff94-sjndv" event={"ID":"75e36d2c-b848-4ee9-8cce-069629513fe0","Type":"ContainerStarted","Data":"5984010cf4898e1e7e565b3960b8967376e09d5fdd56ba6a045d258ee0258e74"} Jul 28 16:37:03.361830 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.361806 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qfctx" event={"ID":"c8b7d602-7f06-4c32-85e7-fd711dcf48ef","Type":"ContainerStarted","Data":"9f0a89283f247c653a62d7a15ba58facb1219d018ce6c5176d876ea29f4763bf"} Jul 28 16:37:03.363716 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.363678 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rk2lg" event={"ID":"43046d78-bb7a-40ab-9e3e-d2d901471738","Type":"ContainerStarted","Data":"209eb7323316e7f66d433a5a222458b08a7fff8feba4c1c5f3b2a323c15b362c"} Jul 28 16:37:03.700213 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.700132 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c4266acf-af05-4015-a11d-2b6686427299-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xpkdj\" (UID: \"c4266acf-af05-4015-a11d-2b6686427299\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xpkdj" Jul 28 16:37:03.703828 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.703794 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c4266acf-af05-4015-a11d-2b6686427299-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-xpkdj\" (UID: \"c4266acf-af05-4015-a11d-2b6686427299\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xpkdj" Jul 28 16:37:03.943133 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:03.943076 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xpkdj" Jul 28 16:37:04.237342 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:04.237285 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67c6854748-sf82n" podStartSLOduration=4.237261942 podStartE2EDuration="4.237261942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:37:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:03.38103315 +0000 UTC m=+68.860581749" watchObservedRunningTime="2026-07-28 16:37:04.237261942 +0000 UTC m=+69.716810549" Jul 28 16:37:04.238444 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:04.238418 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xpkdj"] Jul 28 16:37:04.242134 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:37:04.242104 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4266acf_af05_4015_a11d_2b6686427299.slice/crio-e8343016f513edc605c9873996662c702cfa16d166899f48b20adc3c514290d5 WatchSource:0}: Error finding container e8343016f513edc605c9873996662c702cfa16d166899f48b20adc3c514290d5: Status 404 returned error can't find the container with id e8343016f513edc605c9873996662c702cfa16d166899f48b20adc3c514290d5 Jul 28 16:37:04.370924 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:04.370884 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xpkdj" event={"ID":"c4266acf-af05-4015-a11d-2b6686427299","Type":"ContainerStarted","Data":"e8343016f513edc605c9873996662c702cfa16d166899f48b20adc3c514290d5"} Jul 28 16:37:04.374048 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:04.373287 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-8v2kh" event={"ID":"25ea5499-daf3-488a-8c11-cbd3af4c2587","Type":"ContainerStarted","Data":"e6f19bd7e109e390d5c818e1042cd67818c6107549378d3ef0eea7648decaa6d"} Jul 28 16:37:04.377483 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:04.377316 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rk2lg" event={"ID":"43046d78-bb7a-40ab-9e3e-d2d901471738","Type":"ContainerStarted","Data":"2f9f7ff0ae1306680e5314d11aa5fadb2afbdb9e6bba138f0a5f09819e69adb1"} Jul 28 16:37:04.377483 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:04.377359 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rk2lg" event={"ID":"43046d78-bb7a-40ab-9e3e-d2d901471738","Type":"ContainerStarted","Data":"70f552cf50e483681ba85f54482fc896e0caa5c62f980a9aeaaeae69c4939d06"} Jul 28 16:37:04.393423 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:04.393266 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-8v2kh" podStartSLOduration=2.813181188 podStartE2EDuration="4.393245395s" totalImagesPullingTime="1.580064207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:04.391811936 +0000 UTC m=+69.871360531" watchObservedRunningTime="2026-07-28 16:37:04.393245395 +0000 UTC m=+69.872793992" Jul 28 16:37:04.411162 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:04.409251 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rk2lg" podStartSLOduration=67.835452227 podStartE2EDuration="1m9.409230556s" totalImagesPullingTime="1.573778329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:04.408094281 +0000 UTC m=+69.887642877" watchObservedRunningTime="2026-07-28 16:37:04.409230556 +0000 UTC m=+69.888779151" Jul 28 16:37:09.320992 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.320948 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-wxn6g"] Jul 28 16:37:09.324039 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.324022 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-wxn6g" Jul 28 16:37:09.331751 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.331731 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vvb2d\"" Jul 28 16:37:09.331849 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.331750 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 16:37:09.332243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.332228 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 16:37:09.342592 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.342569 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-wxn6g"] Jul 28 16:37:09.348793 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.348767 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sshwl\" (UniqueName: \"kubernetes.io/projected/5433cfda-c43b-472c-86bf-411f8a634f63-kube-api-access-sshwl\") pod \"downloads-7c97dc4555-wxn6g\" (UID: \"5433cfda-c43b-472c-86bf-411f8a634f63\") " pod="openshift-console/downloads-7c97dc4555-wxn6g" Jul 28 16:37:09.396854 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.396821 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xpkdj" event={"ID":"c4266acf-af05-4015-a11d-2b6686427299","Type":"ContainerStarted","Data":"34abdfb43e4d538172741dad5f03d51f8b79283890c7ab4d9aca547a1b273f22"} Jul 28 16:37:09.397027 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.396883 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xpkdj" Jul 28 16:37:09.398445 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.398417 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ghkxh" event={"ID":"a34f5490-8d32-4aba-808d-5d9a2b0b65e6","Type":"ContainerStarted","Data":"532e427a72f4b4c900eb915f7bbc53d538627f64c2d5fdea2d3fe151382e9f8e"} Jul 28 16:37:09.398569 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.398479 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:37:09.400206 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.400180 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669767ff94-sjndv" event={"ID":"75e36d2c-b848-4ee9-8cce-069629513fe0","Type":"ContainerStarted","Data":"0803d9f462739a17aed172c2ebfa5caadb90023a074b23e060a64dcf8db198ab"} Jul 28 16:37:09.402112 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.402088 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qfctx" event={"ID":"c8b7d602-7f06-4c32-85e7-fd711dcf48ef","Type":"ContainerStarted","Data":"9e83ce9c6ec487e843c4ca70f8c53984772e388f14d7beedeedd882443d558c7"} Jul 28 16:37:09.402286 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.402271 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xpkdj" Jul 28 16:37:09.428191 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.427977 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-xpkdj" podStartSLOduration=1.8389355059999999 podStartE2EDuration="6.427957556s" totalImagesPullingTime="4.58902205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:09.427006257 +0000 UTC m=+74.906554851" watchObservedRunningTime="2026-07-28 16:37:09.427957556 +0000 UTC m=+74.907506155" Jul 28 16:37:09.449974 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.449948 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sshwl\" (UniqueName: \"kubernetes.io/projected/5433cfda-c43b-472c-86bf-411f8a634f63-kube-api-access-sshwl\") pod \"downloads-7c97dc4555-wxn6g\" (UID: \"5433cfda-c43b-472c-86bf-411f8a634f63\") " pod="openshift-console/downloads-7c97dc4555-wxn6g" Jul 28 16:37:09.464466 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.464442 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sshwl\" (UniqueName: \"kubernetes.io/projected/5433cfda-c43b-472c-86bf-411f8a634f63-kube-api-access-sshwl\") pod \"downloads-7c97dc4555-wxn6g\" (UID: \"5433cfda-c43b-472c-86bf-411f8a634f63\") " pod="openshift-console/downloads-7c97dc4555-wxn6g" Jul 28 16:37:09.485722 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.485618 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qfctx" podStartSLOduration=68.13093718 podStartE2EDuration="1m14.485601274s" totalImagesPullingTime="6.354664094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:09.485286664 +0000 UTC m=+74.964835259" watchObservedRunningTime="2026-07-28 16:37:09.485601274 +0000 UTC m=+74.965149868" Jul 28 16:37:09.485972 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.485933 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ghkxh" podStartSLOduration=68.181181838 podStartE2EDuration="1m14.485921358s" totalImagesPullingTime="6.30473952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:09.459016413 +0000 UTC m=+74.938565008" watchObservedRunningTime="2026-07-28 16:37:09.485921358 +0000 UTC m=+74.965469952" Jul 28 16:37:09.505351 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.505304 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669767ff94-sjndv" podStartSLOduration=3.192119507 podStartE2EDuration="9.505287815s" totalImagesPullingTime="6.313168308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:09.504706809 +0000 UTC m=+74.984255393" watchObservedRunningTime="2026-07-28 16:37:09.505287815 +0000 UTC m=+74.984836412" Jul 28 16:37:09.632319 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.632219 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-wxn6g" Jul 28 16:37:09.767194 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:09.767162 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-wxn6g"] Jul 28 16:37:09.771062 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:37:09.771035 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5433cfda_c43b_472c_86bf_411f8a634f63.slice/crio-0a81a0372309cf19f9d61b4b205147a72c7dbbb4ef477b66a7b42268ff41dcde WatchSource:0}: Error finding container 0a81a0372309cf19f9d61b4b205147a72c7dbbb4ef477b66a7b42268ff41dcde: Status 404 returned error can't find the container with id 0a81a0372309cf19f9d61b4b205147a72c7dbbb4ef477b66a7b42268ff41dcde Jul 28 16:37:10.413241 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:10.413199 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-wxn6g" event={"ID":"5433cfda-c43b-472c-86bf-411f8a634f63","Type":"ContainerStarted","Data":"0a81a0372309cf19f9d61b4b205147a72c7dbbb4ef477b66a7b42268ff41dcde"} Jul 28 16:37:14.457910 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.457877 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh"] Jul 28 16:37:14.460001 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.459983 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" Jul 28 16:37:14.462472 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.462441 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 28 16:37:14.462606 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.462443 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 16:37:14.464111 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.464088 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 16:37:14.464111 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.464104 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 28 16:37:14.464307 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.464121 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-cgdmt\"" Jul 28 16:37:14.464307 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.464094 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 16:37:14.467138 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.467114 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h"] Jul 28 16:37:14.469472 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.469453 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.473018 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.472999 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 28 16:37:14.473361 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.473342 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 28 16:37:14.473779 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.473706 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-d8w8t\"" Jul 28 16:37:14.473839 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.473789 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 28 16:37:14.481980 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.481916 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh"] Jul 28 16:37:14.489259 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.489236 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hh8dg"] Jul 28 16:37:14.492089 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.492054 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h"] Jul 28 16:37:14.492242 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.492177 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.494597 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.494540 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 16:37:14.494597 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.494582 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 16:37:14.494938 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.494772 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 16:37:14.495037 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.494943 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7fl9j\"" Jul 28 16:37:14.583647 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.583612 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-wtmp\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.583832 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.583652 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.583832 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.583754 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ec2fd20-2625-4614-aa1b-75edaf251e41-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-jg5qh\" (UID: \"7ec2fd20-2625-4614-aa1b-75edaf251e41\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" Jul 28 16:37:14.583832 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.583798 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccn8f\" (UniqueName: \"kubernetes.io/projected/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-kube-api-access-ccn8f\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.584019 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.583831 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.584019 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.583862 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.584019 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.583888 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjc87\" (UniqueName: \"kubernetes.io/projected/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-kube-api-access-mjc87\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.584019 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.583921 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ec2fd20-2625-4614-aa1b-75edaf251e41-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-jg5qh\" (UID: \"7ec2fd20-2625-4614-aa1b-75edaf251e41\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" Jul 28 16:37:14.584019 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.583962 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-sys\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.584019 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.583994 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-root\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.584282 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.584025 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx6dk\" (UniqueName: \"kubernetes.io/projected/7ec2fd20-2625-4614-aa1b-75edaf251e41-kube-api-access-kx6dk\") pod \"openshift-state-metrics-b8f49f5c6-jg5qh\" (UID: \"7ec2fd20-2625-4614-aa1b-75edaf251e41\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" Jul 28 16:37:14.584282 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.584051 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-metrics-client-ca\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.584282 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.584122 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ec2fd20-2625-4614-aa1b-75edaf251e41-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-jg5qh\" (UID: \"7ec2fd20-2625-4614-aa1b-75edaf251e41\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" Jul 28 16:37:14.584282 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.584169 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.584282 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.584211 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.584282 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.584235 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-textfile\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.584282 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.584276 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-accelerators-collector-config\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.584633 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.584306 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-tls\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.584633 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.584336 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.685590 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.685554 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-textfile\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.685785 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.685596 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-accelerators-collector-config\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.685785 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.685627 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-tls\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.685785 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.685658 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.685785 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.685684 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-wtmp\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.685785 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.685721 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.685785 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.685741 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ec2fd20-2625-4614-aa1b-75edaf251e41-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-jg5qh\" (UID: \"7ec2fd20-2625-4614-aa1b-75edaf251e41\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" Jul 28 16:37:14.685785 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.685758 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccn8f\" (UniqueName: \"kubernetes.io/projected/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-kube-api-access-ccn8f\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.685785 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.685782 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.686194 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.685813 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.686194 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.685837 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjc87\" (UniqueName: \"kubernetes.io/projected/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-kube-api-access-mjc87\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.686194 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.685870 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ec2fd20-2625-4614-aa1b-75edaf251e41-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-jg5qh\" (UID: \"7ec2fd20-2625-4614-aa1b-75edaf251e41\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" Jul 28 16:37:14.686194 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.685896 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-sys\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.686194 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.685923 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-root\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.686194 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.685959 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx6dk\" (UniqueName: \"kubernetes.io/projected/7ec2fd20-2625-4614-aa1b-75edaf251e41-kube-api-access-kx6dk\") pod \"openshift-state-metrics-b8f49f5c6-jg5qh\" (UID: \"7ec2fd20-2625-4614-aa1b-75edaf251e41\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" Jul 28 16:37:14.686194 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.685985 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-metrics-client-ca\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.686194 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.686017 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ec2fd20-2625-4614-aa1b-75edaf251e41-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-jg5qh\" (UID: \"7ec2fd20-2625-4614-aa1b-75edaf251e41\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" Jul 28 16:37:14.686194 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.686039 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-textfile\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.686194 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.686053 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.686194 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.686117 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.686671 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.686306 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-accelerators-collector-config\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.686671 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:37:14.686418 2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 16:37:14.686671 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:37:14.686490 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-tls podName:0538e8cd-1cdd-4daf-8a97-37b13f9e4add nodeName:}" failed. No retries permitted until 2026-07-28 16:37:15.18647175 +0000 UTC m=+80.666020322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-tls") pod "node-exporter-hh8dg" (UID: "0538e8cd-1cdd-4daf-8a97-37b13f9e4add") : secret "node-exporter-tls" not found Jul 28 16:37:14.686671 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.686552 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.687586 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.687185 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-sys\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.687586 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.687245 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-root\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.687586 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.687283 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ec2fd20-2625-4614-aa1b-75edaf251e41-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-jg5qh\" (UID: \"7ec2fd20-2625-4614-aa1b-75edaf251e41\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" Jul 28 16:37:14.687586 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.687345 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.687586 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.687393 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.687586 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.687495 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-wtmp\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.688018 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.687974 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-metrics-client-ca\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.690180 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.690138 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.690919 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.690674 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.691051 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.690946 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.691051 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.690990 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ec2fd20-2625-4614-aa1b-75edaf251e41-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-jg5qh\" (UID: \"7ec2fd20-2625-4614-aa1b-75edaf251e41\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" Jul 28 16:37:14.692165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.692139 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ec2fd20-2625-4614-aa1b-75edaf251e41-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-jg5qh\" (UID: \"7ec2fd20-2625-4614-aa1b-75edaf251e41\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" Jul 28 16:37:14.703332 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.703307 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjc87\" (UniqueName: \"kubernetes.io/projected/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-kube-api-access-mjc87\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:14.703410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.703367 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx6dk\" (UniqueName: \"kubernetes.io/projected/7ec2fd20-2625-4614-aa1b-75edaf251e41-kube-api-access-kx6dk\") pod \"openshift-state-metrics-b8f49f5c6-jg5qh\" (UID: \"7ec2fd20-2625-4614-aa1b-75edaf251e41\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" Jul 28 16:37:14.704092 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.704073 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccn8f\" (UniqueName: \"kubernetes.io/projected/600bd436-3e95-4e94-a3c7-d4c1a6e8a16a-kube-api-access-ccn8f\") pod \"kube-state-metrics-56d9f944b4-hpg4h\" (UID: \"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.772115 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.772041 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" Jul 28 16:37:14.781568 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.781542 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" Jul 28 16:37:14.937051 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.937022 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh"] Jul 28 16:37:14.940325 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:37:14.940296 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec2fd20_2625_4614_aa1b_75edaf251e41.slice/crio-3d2cd871c1cfea70d81a0e7174aa65ffd43e93ad342c3ea8ef762b6cd6375421 WatchSource:0}: Error finding container 3d2cd871c1cfea70d81a0e7174aa65ffd43e93ad342c3ea8ef762b6cd6375421: Status 404 returned error can't find the container with id 3d2cd871c1cfea70d81a0e7174aa65ffd43e93ad342c3ea8ef762b6cd6375421 Jul 28 16:37:14.958337 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:14.958313 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h"] Jul 28 16:37:14.961926 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:37:14.961905 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod600bd436_3e95_4e94_a3c7_d4c1a6e8a16a.slice/crio-25834fd32943a3a2cd2e52a53808713110cd6ac082a4112e21be0946ab8e9fb9 WatchSource:0}: Error finding container 25834fd32943a3a2cd2e52a53808713110cd6ac082a4112e21be0946ab8e9fb9: Status 404 returned error can't find the container with id 25834fd32943a3a2cd2e52a53808713110cd6ac082a4112e21be0946ab8e9fb9 Jul 28 16:37:15.190075 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:15.190035 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-tls\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:15.192540 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:15.192508 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0538e8cd-1cdd-4daf-8a97-37b13f9e4add-node-exporter-tls\") pod \"node-exporter-hh8dg\" (UID: \"0538e8cd-1cdd-4daf-8a97-37b13f9e4add\") " pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:15.402973 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:15.402937 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hh8dg" Jul 28 16:37:15.414491 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:37:15.414460 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0538e8cd_1cdd_4daf_8a97_37b13f9e4add.slice/crio-3b9c2feec25a0f03672c3f45ec45d52523cd15e160d1b412b99972e6bdf6ec4e WatchSource:0}: Error finding container 3b9c2feec25a0f03672c3f45ec45d52523cd15e160d1b412b99972e6bdf6ec4e: Status 404 returned error can't find the container with id 3b9c2feec25a0f03672c3f45ec45d52523cd15e160d1b412b99972e6bdf6ec4e Jul 28 16:37:15.434738 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:15.434663 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" event={"ID":"7ec2fd20-2625-4614-aa1b-75edaf251e41","Type":"ContainerStarted","Data":"9f39433fd9540bc78d7839f229e5fb86ee336b33ce51f1239b2d0d4ce686a7eb"} Jul 28 16:37:15.434900 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:15.434774 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" event={"ID":"7ec2fd20-2625-4614-aa1b-75edaf251e41","Type":"ContainerStarted","Data":"ec5b82044527a0317822b8501413c0f630b390566762e0eff4c12cef773bde92"} Jul 28 16:37:15.434900 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:15.434810 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" event={"ID":"7ec2fd20-2625-4614-aa1b-75edaf251e41","Type":"ContainerStarted","Data":"3d2cd871c1cfea70d81a0e7174aa65ffd43e93ad342c3ea8ef762b6cd6375421"} Jul 28 16:37:15.436103 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:15.436076 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" event={"ID":"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a","Type":"ContainerStarted","Data":"25834fd32943a3a2cd2e52a53808713110cd6ac082a4112e21be0946ab8e9fb9"} Jul 28 16:37:15.437375 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:15.437324 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hh8dg" event={"ID":"0538e8cd-1cdd-4daf-8a97-37b13f9e4add","Type":"ContainerStarted","Data":"3b9c2feec25a0f03672c3f45ec45d52523cd15e160d1b412b99972e6bdf6ec4e"} Jul 28 16:37:17.446793 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.446762 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6644c499d4-bssj2"] Jul 28 16:37:17.449639 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.449608 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.450124 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.450092 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" event={"ID":"7ec2fd20-2625-4614-aa1b-75edaf251e41","Type":"ContainerStarted","Data":"e9524c34ab2a6b35dd85ee89f9b8a0de35378b3ba733c396ecbf070d63399c37"} Jul 28 16:37:17.452769 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.452196 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gzbpj\"" Jul 28 16:37:17.452769 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.452486 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 28 16:37:17.452769 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.452525 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 28 16:37:17.452769 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.452548 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9lcmd98nvk69c\"" Jul 28 16:37:17.452769 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.452486 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 28 16:37:17.452769 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.452762 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 28 16:37:17.453221 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.452903 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 28 16:37:17.454191 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.454029 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" event={"ID":"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a","Type":"ContainerStarted","Data":"627da62c735ebda055889ba28d586ef73030c3f91113a705f6bd7f03d4caedf6"} Jul 28 16:37:17.454191 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.454098 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" event={"ID":"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a","Type":"ContainerStarted","Data":"8304186c2a685420d8f6dbca63f4695bd323130bbb9e36e4a93d6a9181d6a5e2"} Jul 28 16:37:17.454191 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.454149 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" event={"ID":"600bd436-3e95-4e94-a3c7-d4c1a6e8a16a","Type":"ContainerStarted","Data":"d87257a487eb12510908bac3556474f6dbad244aa3f6ae0f1f3514d35709bc51"} Jul 28 16:37:17.457011 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.456980 2570 generic.go:356] "Generic (PLEG): container finished" podID="0538e8cd-1cdd-4daf-8a97-37b13f9e4add" containerID="181a6a1ee47d6843ffcfdba843828edbcfdf97a85e6316511e8cfde1aba0a4de" exitCode=0 Jul 28 16:37:17.457114 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.457053 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hh8dg" event={"ID":"0538e8cd-1cdd-4daf-8a97-37b13f9e4add","Type":"ContainerDied","Data":"181a6a1ee47d6843ffcfdba843828edbcfdf97a85e6316511e8cfde1aba0a4de"} Jul 28 16:37:17.466132 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.466040 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6644c499d4-bssj2"] Jul 28 16:37:17.501638 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.501578 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-jg5qh" podStartSLOduration=1.638650462 podStartE2EDuration="3.501555612s" totalImagesPullingTime="1.86290515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:17.499821419 +0000 UTC m=+82.979370014" watchObservedRunningTime="2026-07-28 16:37:17.501555612 +0000 UTC m=+82.981104207" Jul 28 16:37:17.510563 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.509744 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.510563 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.509817 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-grpc-tls\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.510563 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.509861 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e36c62b2-b2b7-4028-b404-e4be3f0b4559-metrics-client-ca\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.510563 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.509927 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.510563 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.509952 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.510563 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.510017 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-thanos-querier-tls\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.510563 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.510116 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xmzm\" (UniqueName: \"kubernetes.io/projected/e36c62b2-b2b7-4028-b404-e4be3f0b4559-kube-api-access-9xmzm\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.510563 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.510207 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.610909 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.610884 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.611072 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.610940 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-grpc-tls\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.611072 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.610978 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e36c62b2-b2b7-4028-b404-e4be3f0b4559-metrics-client-ca\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.611072 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.611017 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.611072 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.611047 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.611803 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.611088 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-thanos-querier-tls\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.611803 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.611128 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xmzm\" (UniqueName: \"kubernetes.io/projected/e36c62b2-b2b7-4028-b404-e4be3f0b4559-kube-api-access-9xmzm\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.611803 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.611171 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.611803 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.611760 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e36c62b2-b2b7-4028-b404-e4be3f0b4559-metrics-client-ca\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.614540 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.614517 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-grpc-tls\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.614942 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.614921 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.615384 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.615366 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.615581 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.615561 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.616111 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.615959 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.617928 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.617906 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e36c62b2-b2b7-4028-b404-e4be3f0b4559-secret-thanos-querier-tls\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.621168 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.621134 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xmzm\" (UniqueName: \"kubernetes.io/projected/e36c62b2-b2b7-4028-b404-e4be3f0b4559-kube-api-access-9xmzm\") pod \"thanos-querier-6644c499d4-bssj2\" (UID: \"e36c62b2-b2b7-4028-b404-e4be3f0b4559\") " pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.761434 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.761351 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:17.908537 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.908466 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-hpg4h" podStartSLOduration=1.9388552209999999 podStartE2EDuration="3.908440814s" totalImagesPullingTime="1.969585593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:17.556051508 +0000 UTC m=+83.035600102" watchObservedRunningTime="2026-07-28 16:37:17.908440814 +0000 UTC m=+83.387989404" Jul 28 16:37:17.910207 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:17.910109 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6644c499d4-bssj2"] Jul 28 16:37:17.914518 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:37:17.914483 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36c62b2_b2b7_4028_b404_e4be3f0b4559.slice/crio-2743724176b0e5ebb64b341cd5c0b293543ac0deae559be235756f2e335cd0db WatchSource:0}: Error finding container 2743724176b0e5ebb64b341cd5c0b293543ac0deae559be235756f2e335cd0db: Status 404 returned error can't find the container with id 2743724176b0e5ebb64b341cd5c0b293543ac0deae559be235756f2e335cd0db Jul 28 16:37:18.433077 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.433045 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d797cdbc4-r2wjd"] Jul 28 16:37:18.438914 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.438888 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.441374 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.441346 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 16:37:18.441489 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.441345 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 16:37:18.442236 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.442175 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sll5t\"" Jul 28 16:37:18.442236 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.442219 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 16:37:18.442434 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.442284 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 16:37:18.442434 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.442288 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 16:37:18.449515 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.449460 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d797cdbc4-r2wjd"] Jul 28 16:37:18.464237 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.464204 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hh8dg" event={"ID":"0538e8cd-1cdd-4daf-8a97-37b13f9e4add","Type":"ContainerStarted","Data":"7204fb9a45f2d16913bea6a7058051e3cf4643735629f14a870a08094959c3c2"} Jul 28 16:37:18.464384 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.464263 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hh8dg" event={"ID":"0538e8cd-1cdd-4daf-8a97-37b13f9e4add","Type":"ContainerStarted","Data":"8a8c47250d4d437bdcd6236a276cdd833f5ec0cbeb8778b0644d062a006b844f"} Jul 28 16:37:18.465770 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.465698 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" event={"ID":"e36c62b2-b2b7-4028-b404-e4be3f0b4559","Type":"ContainerStarted","Data":"2743724176b0e5ebb64b341cd5c0b293543ac0deae559be235756f2e335cd0db"} Jul 28 16:37:18.495928 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.495878 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hh8dg" podStartSLOduration=2.877351651 podStartE2EDuration="4.495861889s" totalImagesPullingTime="1.519534466s" totalInitContainerRuntime="98.975772ms" isStatefulPod=true podCreationTimestamp="2026-07-28 16:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:18.494517348 +0000 UTC m=+83.974065943" watchObservedRunningTime="2026-07-28 16:37:18.495861889 +0000 UTC m=+83.975410483" Jul 28 16:37:18.518020 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.517987 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-service-ca\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.518273 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.518239 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-oauth-serving-cert\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.518410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.518278 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q8qf\" (UniqueName: \"kubernetes.io/projected/ac9a931e-61a1-4476-9b76-8440065ecfd9-kube-api-access-7q8qf\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.518410 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.518307 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-serving-cert\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.518577 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.518554 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-config\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.518735 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.518685 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-oauth-config\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.619334 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.619303 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-config\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.619334 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.619342 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-oauth-config\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.619547 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.619373 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-service-ca\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.619547 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.619421 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-oauth-serving-cert\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.619547 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.619438 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q8qf\" (UniqueName: \"kubernetes.io/projected/ac9a931e-61a1-4476-9b76-8440065ecfd9-kube-api-access-7q8qf\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.619846 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.619488 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-serving-cert\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.625383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.620927 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-config\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.625383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.620930 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-service-ca\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.625383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.621288 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-oauth-serving-cert\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.625383 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.623647 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-serving-cert\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.626262 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.626213 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-oauth-config\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.629107 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.629086 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q8qf\" (UniqueName: \"kubernetes.io/projected/ac9a931e-61a1-4476-9b76-8440065ecfd9-kube-api-access-7q8qf\") pod \"console-5d797cdbc4-r2wjd\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.751323 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.751237 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:18.905065 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:18.905036 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d797cdbc4-r2wjd"] Jul 28 16:37:18.907992 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:37:18.907955 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac9a931e_61a1_4476_9b76_8440065ecfd9.slice/crio-d8eff604a9dc544021ea4a375c678e0ab765c73d70806261d86901f424e8577a WatchSource:0}: Error finding container d8eff604a9dc544021ea4a375c678e0ab765c73d70806261d86901f424e8577a: Status 404 returned error can't find the container with id d8eff604a9dc544021ea4a375c678e0ab765c73d70806261d86901f424e8577a Jul 28 16:37:19.471099 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.471064 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d797cdbc4-r2wjd" event={"ID":"ac9a931e-61a1-4476-9b76-8440065ecfd9","Type":"ContainerStarted","Data":"d8eff604a9dc544021ea4a375c678e0ab765c73d70806261d86901f424e8577a"} Jul 28 16:37:19.704381 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.703544 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f55877cd5-zxsc8"] Jul 28 16:37:19.707460 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.707414 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.710179 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.710151 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 28 16:37:19.710179 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.710171 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 28 16:37:19.710456 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.710440 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 28 16:37:19.710456 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.710449 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 28 16:37:19.710680 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.710667 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ktj2f\"" Jul 28 16:37:19.710750 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.710701 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 28 16:37:19.715483 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.715462 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 28 16:37:19.721914 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.721859 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f55877cd5-zxsc8"] Jul 28 16:37:19.832531 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.832503 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b345d10-1db3-400f-9183-e773250777e3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.832725 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.832539 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b345d10-1db3-400f-9183-e773250777e3-serving-certs-ca-bundle\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.832725 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.832560 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b345d10-1db3-400f-9183-e773250777e3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.832725 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.832650 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6b345d10-1db3-400f-9183-e773250777e3-telemeter-client-tls\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.832725 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.832710 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b345d10-1db3-400f-9183-e773250777e3-metrics-client-ca\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.832895 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.832734 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6b345d10-1db3-400f-9183-e773250777e3-secret-telemeter-client\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.832895 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.832760 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6b345d10-1db3-400f-9183-e773250777e3-federate-client-tls\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.832895 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.832776 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxb9j\" (UniqueName: \"kubernetes.io/projected/6b345d10-1db3-400f-9183-e773250777e3-kube-api-access-zxb9j\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.934067 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.934028 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b345d10-1db3-400f-9183-e773250777e3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.934253 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.934083 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b345d10-1db3-400f-9183-e773250777e3-serving-certs-ca-bundle\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.934253 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.934115 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b345d10-1db3-400f-9183-e773250777e3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.934253 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.934155 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6b345d10-1db3-400f-9183-e773250777e3-telemeter-client-tls\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.934253 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.934181 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b345d10-1db3-400f-9183-e773250777e3-metrics-client-ca\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.934253 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.934213 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6b345d10-1db3-400f-9183-e773250777e3-secret-telemeter-client\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.934253 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.934244 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6b345d10-1db3-400f-9183-e773250777e3-federate-client-tls\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.934544 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.934266 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxb9j\" (UniqueName: \"kubernetes.io/projected/6b345d10-1db3-400f-9183-e773250777e3-kube-api-access-zxb9j\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.936049 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.935987 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b345d10-1db3-400f-9183-e773250777e3-metrics-client-ca\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.937591 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.937539 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b345d10-1db3-400f-9183-e773250777e3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.938040 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.937978 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b345d10-1db3-400f-9183-e773250777e3-serving-certs-ca-bundle\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.940192 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.940149 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b345d10-1db3-400f-9183-e773250777e3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.941245 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.941191 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6b345d10-1db3-400f-9183-e773250777e3-federate-client-tls\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.946102 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.946066 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxb9j\" (UniqueName: \"kubernetes.io/projected/6b345d10-1db3-400f-9183-e773250777e3-kube-api-access-zxb9j\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.947746 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.947706 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6b345d10-1db3-400f-9183-e773250777e3-telemeter-client-tls\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:19.948660 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:19.948461 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6b345d10-1db3-400f-9183-e773250777e3-secret-telemeter-client\") pod \"telemeter-client-7f55877cd5-zxsc8\" (UID: \"6b345d10-1db3-400f-9183-e773250777e3\") " pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:20.019555 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.019469 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" Jul 28 16:37:20.631099 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.631070 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f55877cd5-zxsc8"] Jul 28 16:37:20.635943 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:37:20.635916 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b345d10_1db3_400f_9183_e773250777e3.slice/crio-e8a21109fbb0e58a476c6318d56dbaaa53acb848e14277418b4f01b16d6fe2ed WatchSource:0}: Error finding container e8a21109fbb0e58a476c6318d56dbaaa53acb848e14277418b4f01b16d6fe2ed: Status 404 returned error can't find the container with id e8a21109fbb0e58a476c6318d56dbaaa53acb848e14277418b4f01b16d6fe2ed Jul 28 16:37:20.767136 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.767043 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 16:37:20.771536 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.771510 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.774878 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.774819 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 16:37:20.774878 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.774848 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 16:37:20.775083 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.774819 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 16:37:20.775489 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.775270 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 16:37:20.775489 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.775296 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 16:37:20.775489 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.775340 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gt2sm\"" Jul 28 16:37:20.775800 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.775775 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 16:37:20.776065 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.776047 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 16:37:20.776202 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.776081 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 16:37:20.776202 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.776107 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 16:37:20.776583 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.776509 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 16:37:20.778986 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.778963 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 16:37:20.779109 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.779094 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 16:37:20.783606 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.781260 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 16:37:20.783832 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.781536 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1r8gmkm1gkmqc\"" Jul 28 16:37:20.783949 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.781835 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 16:37:20.785860 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.785402 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 16:37:20.790387 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.790367 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 16:37:20.843176 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843138 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.843364 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843189 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.843364 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843255 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.843364 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843302 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.843364 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843343 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.843364 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843361 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4g84\" (UniqueName: \"kubernetes.io/projected/10a1dddc-8370-4960-96f4-1085b7a85f07-kube-api-access-h4g84\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.843608 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843387 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.843608 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843429 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-web-config\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.843608 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843504 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.843608 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843568 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.843608 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843591 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.843608 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843608 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.843873 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843644 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.843873 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843706 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-config\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.843873 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843745 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.843873 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843772 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.843873 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843816 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.843873 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843854 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.844181 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843882 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10a1dddc-8370-4960-96f4-1085b7a85f07-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.844181 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.843911 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10a1dddc-8370-4960-96f4-1085b7a85f07-config-out\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.944956 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.944916 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945141 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.944967 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10a1dddc-8370-4960-96f4-1085b7a85f07-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945141 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.944997 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10a1dddc-8370-4960-96f4-1085b7a85f07-config-out\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945141 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945038 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945293 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945175 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945293 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945214 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945293 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945273 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945444 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945324 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945444 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945353 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4g84\" (UniqueName: \"kubernetes.io/projected/10a1dddc-8370-4960-96f4-1085b7a85f07-kube-api-access-h4g84\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945444 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945384 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945444 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945409 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-web-config\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945642 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945442 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945642 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945482 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945642 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945512 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945642 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945543 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945642 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945588 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945642 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945620 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-config\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945963 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945656 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945963 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945682 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.945963 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945748 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.946118 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.945974 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.948991 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.947944 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10a1dddc-8370-4960-96f4-1085b7a85f07-config-out\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.948991 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.948684 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.948991 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.948815 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.948991 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.948840 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.949216 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.949149 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.949454 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.949425 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.949615 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.949592 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10a1dddc-8370-4960-96f4-1085b7a85f07-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.950047 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.949753 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.950047 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.949764 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.950230 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.950196 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.950419 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.950394 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.950492 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.950396 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.951045 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.950680 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.951045 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.950978 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.951928 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.951888 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-web-config\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.952103 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.952086 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-config\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.952314 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.952290 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.952509 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.952491 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:20.958259 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:20.958239 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4g84\" (UniqueName: \"kubernetes.io/projected/10a1dddc-8370-4960-96f4-1085b7a85f07-kube-api-access-h4g84\") pod \"prometheus-k8s-0\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:21.090121 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:21.090085 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:21.481528 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:21.481442 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" event={"ID":"e36c62b2-b2b7-4028-b404-e4be3f0b4559","Type":"ContainerStarted","Data":"658a52a41786ef124fe731add6b9d6a37a29d36a57bc10fde919d1fb640fefd7"} Jul 28 16:37:21.481726 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:21.481531 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" event={"ID":"e36c62b2-b2b7-4028-b404-e4be3f0b4559","Type":"ContainerStarted","Data":"aae439caccb630ef70fd50e986ca93fefb9567163a74c8ec9226f88a2b08b8cb"} Jul 28 16:37:21.482866 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:21.482838 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" event={"ID":"6b345d10-1db3-400f-9183-e773250777e3","Type":"ContainerStarted","Data":"e8a21109fbb0e58a476c6318d56dbaaa53acb848e14277418b4f01b16d6fe2ed"} Jul 28 16:37:24.382564 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:24.382534 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67c6854748-sf82n" Jul 28 16:37:30.246887 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:30.246836 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 16:37:30.393544 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:37:30.393468 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10a1dddc_8370_4960_96f4_1085b7a85f07.slice/crio-a1b327e4e4ab999497b0b9512c7c8158a931e35d1916d24ef7000aa4ac847415 WatchSource:0}: Error finding container a1b327e4e4ab999497b0b9512c7c8158a931e35d1916d24ef7000aa4ac847415: Status 404 returned error can't find the container with id a1b327e4e4ab999497b0b9512c7c8158a931e35d1916d24ef7000aa4ac847415 Jul 28 16:37:30.523245 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:30.523216 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" event={"ID":"e36c62b2-b2b7-4028-b404-e4be3f0b4559","Type":"ContainerStarted","Data":"4cf9ba6c58fc34db9282a16f52babf26e70063b9a9ebb80e8125bc6c9dbd41bc"} Jul 28 16:37:30.524673 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:30.524645 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10a1dddc-8370-4960-96f4-1085b7a85f07","Type":"ContainerStarted","Data":"a1b327e4e4ab999497b0b9512c7c8158a931e35d1916d24ef7000aa4ac847415"} Jul 28 16:37:30.528655 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:30.528608 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d797cdbc4-r2wjd" event={"ID":"ac9a931e-61a1-4476-9b76-8440065ecfd9","Type":"ContainerStarted","Data":"08a9723144fa0d176d1ad04ffafe6e3ef956e2916e84937dd4e9bb7279470d48"} Jul 28 16:37:30.530386 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:30.530356 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-wxn6g" event={"ID":"5433cfda-c43b-472c-86bf-411f8a634f63","Type":"ContainerStarted","Data":"f2adcdbd3097b78f3272163b7931b8bdb5948252049ff05a7aa6599660c4a7ca"} Jul 28 16:37:30.530577 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:30.530555 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-wxn6g" Jul 28 16:37:30.532076 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:30.532053 2570 patch_prober.go:28] interesting pod/downloads-7c97dc4555-wxn6g container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused" start-of-body= Jul 28 16:37:30.532172 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:30.532096 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-wxn6g" podUID="5433cfda-c43b-472c-86bf-411f8a634f63" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused" Jul 28 16:37:30.549743 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:30.549673 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d797cdbc4-r2wjd" podStartSLOduration=1.354593819 podStartE2EDuration="12.549656897s" totalImagesPullingTime="11.195063078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:30.548080952 +0000 UTC m=+96.027629555" watchObservedRunningTime="2026-07-28 16:37:30.549656897 +0000 UTC m=+96.029205490" Jul 28 16:37:31.541592 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:31.541160 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" event={"ID":"6b345d10-1db3-400f-9183-e773250777e3","Type":"ContainerStarted","Data":"fa181766e4dbd7e66ea2cda6e85cefa72de4e316eab94b3c67727aea469061da"} Jul 28 16:37:31.552833 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:31.552801 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-wxn6g" Jul 28 16:37:31.571881 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:31.571834 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-wxn6g" podStartSLOduration=2.243194763 podStartE2EDuration="22.571812599s" totalImagesPullingTime="20.328617836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:37:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:30.565794816 +0000 UTC m=+96.045343412" watchObservedRunningTime="2026-07-28 16:37:31.571812599 +0000 UTC m=+97.051361195" Jul 28 16:37:32.549519 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:32.549481 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" event={"ID":"e36c62b2-b2b7-4028-b404-e4be3f0b4559","Type":"ContainerStarted","Data":"7a2ccdf5779624c48be7eb89b8d4ece261f2c0c5537450948bb13c052976dd26"} Jul 28 16:37:32.549985 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:32.549564 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" event={"ID":"e36c62b2-b2b7-4028-b404-e4be3f0b4559","Type":"ContainerStarted","Data":"2d69d20ecb2cd081c679ee04995100d069b7451a8d7917f7ed384ccf68ee71f4"} Jul 28 16:37:32.549985 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:32.549606 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" event={"ID":"e36c62b2-b2b7-4028-b404-e4be3f0b4559","Type":"ContainerStarted","Data":"f19a6bd6992c13aff0f7fd82f39ca60a0dd9c1d21c6a072d4e3c2a0e3b6fdad9"} Jul 28 16:37:32.572260 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:32.572200 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" podStartSLOduration=11.672975171000001 podStartE2EDuration="15.5721791s" totalImagesPullingTime="3.899203929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:37:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:32.572031242 +0000 UTC m=+98.051579836" watchObservedRunningTime="2026-07-28 16:37:32.5721791 +0000 UTC m=+98.051727691" Jul 28 16:37:33.555525 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:33.555487 2570 generic.go:356] "Generic (PLEG): container finished" podID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerID="52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82" exitCode=0 Jul 28 16:37:33.555997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:33.555577 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10a1dddc-8370-4960-96f4-1085b7a85f07","Type":"ContainerDied","Data":"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82"} Jul 28 16:37:33.558215 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:33.558188 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" event={"ID":"6b345d10-1db3-400f-9183-e773250777e3","Type":"ContainerStarted","Data":"6bbfc4368aaca3f700064220e429fffb2877b30cc1bdce1b6916ea631f101b52"} Jul 28 16:37:33.558602 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:33.558507 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:33.558602 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:33.558566 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" event={"ID":"6b345d10-1db3-400f-9183-e773250777e3","Type":"ContainerStarted","Data":"4f8e31606a1af4d5312de84d37d9ab1398faea2fee3ac84658d32a3c82bf277e"} Jul 28 16:37:33.564850 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:33.564828 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6644c499d4-bssj2" Jul 28 16:37:33.626555 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:33.626482 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f55877cd5-zxsc8" podStartSLOduration=2.496912655 podStartE2EDuration="14.626462203s" totalImagesPullingTime="12.129549548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:37:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:33.624543593 +0000 UTC m=+99.104092190" watchObservedRunningTime="2026-07-28 16:37:33.626462203 +0000 UTC m=+99.106010798" Jul 28 16:37:34.545478 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:34.545441 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d797cdbc4-r2wjd"] Jul 28 16:37:37.584094 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:37.584051 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10a1dddc-8370-4960-96f4-1085b7a85f07","Type":"ContainerStarted","Data":"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98"} Jul 28 16:37:38.592754 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:38.592711 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10a1dddc-8370-4960-96f4-1085b7a85f07","Type":"ContainerStarted","Data":"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482"} Jul 28 16:37:38.593192 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:38.592800 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10a1dddc-8370-4960-96f4-1085b7a85f07","Type":"ContainerStarted","Data":"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2"} Jul 28 16:37:38.593192 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:38.592837 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10a1dddc-8370-4960-96f4-1085b7a85f07","Type":"ContainerStarted","Data":"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137"} Jul 28 16:37:38.593192 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:38.592865 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10a1dddc-8370-4960-96f4-1085b7a85f07","Type":"ContainerStarted","Data":"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c"} Jul 28 16:37:38.593192 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:38.592898 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10a1dddc-8370-4960-96f4-1085b7a85f07","Type":"ContainerStarted","Data":"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29"} Jul 28 16:37:38.624817 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:38.624755 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=12.277431947 podStartE2EDuration="18.624656928s" totalImagesPullingTime="6.329118186s" totalInitContainerRuntime="18.106795ms" isStatefulPod=false podCreationTimestamp="2026-07-28 16:37:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:38.623558126 +0000 UTC m=+104.103106713" watchObservedRunningTime="2026-07-28 16:37:38.624656928 +0000 UTC m=+104.104205523" Jul 28 16:37:38.751617 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:38.751581 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:40.415709 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:40.415664 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ghkxh" Jul 28 16:37:41.090312 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:41.090277 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:37:59.572134 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.572072 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d797cdbc4-r2wjd" podUID="ac9a931e-61a1-4476-9b76-8440065ecfd9" containerName="console" containerID="cri-o://08a9723144fa0d176d1ad04ffafe6e3ef956e2916e84937dd4e9bb7279470d48" gracePeriod=15 Jul 28 16:37:59.846560 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.846536 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:37:59.892395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.892363 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-service-ca\") pod \"ac9a931e-61a1-4476-9b76-8440065ecfd9\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " Jul 28 16:37:59.892563 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.892400 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-oauth-config\") pod \"ac9a931e-61a1-4476-9b76-8440065ecfd9\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " Jul 28 16:37:59.892563 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.892431 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-config\") pod \"ac9a931e-61a1-4476-9b76-8440065ecfd9\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " Jul 28 16:37:59.892563 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.892526 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-serving-cert\") pod \"ac9a931e-61a1-4476-9b76-8440065ecfd9\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " Jul 28 16:37:59.892563 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.892562 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7q8qf\" (UniqueName: \"kubernetes.io/projected/ac9a931e-61a1-4476-9b76-8440065ecfd9-kube-api-access-7q8qf\") pod \"ac9a931e-61a1-4476-9b76-8440065ecfd9\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " Jul 28 16:37:59.892793 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.892591 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-oauth-serving-cert\") pod \"ac9a931e-61a1-4476-9b76-8440065ecfd9\" (UID: \"ac9a931e-61a1-4476-9b76-8440065ecfd9\") " Jul 28 16:37:59.892847 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.892810 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-service-ca" (OuterVolumeSpecName: "service-ca") pod "ac9a931e-61a1-4476-9b76-8440065ecfd9" (UID: "ac9a931e-61a1-4476-9b76-8440065ecfd9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:37:59.892970 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.892873 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-config" (OuterVolumeSpecName: "console-config") pod "ac9a931e-61a1-4476-9b76-8440065ecfd9" (UID: "ac9a931e-61a1-4476-9b76-8440065ecfd9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:37:59.893043 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.893003 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ac9a931e-61a1-4476-9b76-8440065ecfd9" (UID: "ac9a931e-61a1-4476-9b76-8440065ecfd9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:37:59.894851 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.894824 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ac9a931e-61a1-4476-9b76-8440065ecfd9" (UID: "ac9a931e-61a1-4476-9b76-8440065ecfd9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:37:59.894851 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.894838 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac9a931e-61a1-4476-9b76-8440065ecfd9-kube-api-access-7q8qf" (OuterVolumeSpecName: "kube-api-access-7q8qf") pod "ac9a931e-61a1-4476-9b76-8440065ecfd9" (UID: "ac9a931e-61a1-4476-9b76-8440065ecfd9"). InnerVolumeSpecName "kube-api-access-7q8qf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:37:59.895011 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.894898 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ac9a931e-61a1-4476-9b76-8440065ecfd9" (UID: "ac9a931e-61a1-4476-9b76-8440065ecfd9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:37:59.994065 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.994026 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-serving-cert\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:37:59.994065 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.994060 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q8qf\" (UniqueName: \"kubernetes.io/projected/ac9a931e-61a1-4476-9b76-8440065ecfd9-kube-api-access-7q8qf\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:37:59.994065 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.994073 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-oauth-serving-cert\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:37:59.994309 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.994086 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-service-ca\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:37:59.994309 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.994099 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-oauth-config\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:37:59.994309 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:37:59.994110 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac9a931e-61a1-4476-9b76-8440065ecfd9-console-config\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:00.684580 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:00.684542 2570 generic.go:356] "Generic (PLEG): container finished" podID="ac9a931e-61a1-4476-9b76-8440065ecfd9" containerID="08a9723144fa0d176d1ad04ffafe6e3ef956e2916e84937dd4e9bb7279470d48" exitCode=0 Jul 28 16:38:00.685055 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:00.684588 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d797cdbc4-r2wjd" Jul 28 16:38:00.685055 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:00.684626 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d797cdbc4-r2wjd" event={"ID":"ac9a931e-61a1-4476-9b76-8440065ecfd9","Type":"ContainerDied","Data":"08a9723144fa0d176d1ad04ffafe6e3ef956e2916e84937dd4e9bb7279470d48"} Jul 28 16:38:00.685055 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:00.684715 2570 scope.go:117] "RemoveContainer" containerID="08a9723144fa0d176d1ad04ffafe6e3ef956e2916e84937dd4e9bb7279470d48" Jul 28 16:38:00.685055 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:00.684819 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d797cdbc4-r2wjd" event={"ID":"ac9a931e-61a1-4476-9b76-8440065ecfd9","Type":"ContainerDied","Data":"d8eff604a9dc544021ea4a375c678e0ab765c73d70806261d86901f424e8577a"} Jul 28 16:38:00.699553 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:00.699538 2570 scope.go:117] "RemoveContainer" containerID="08a9723144fa0d176d1ad04ffafe6e3ef956e2916e84937dd4e9bb7279470d48" Jul 28 16:38:00.699859 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:38:00.699835 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08a9723144fa0d176d1ad04ffafe6e3ef956e2916e84937dd4e9bb7279470d48\": container with ID starting with 08a9723144fa0d176d1ad04ffafe6e3ef956e2916e84937dd4e9bb7279470d48 not found: ID does not exist" containerID="08a9723144fa0d176d1ad04ffafe6e3ef956e2916e84937dd4e9bb7279470d48" Jul 28 16:38:00.699946 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:00.699869 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08a9723144fa0d176d1ad04ffafe6e3ef956e2916e84937dd4e9bb7279470d48"} err="failed to get container status \"08a9723144fa0d176d1ad04ffafe6e3ef956e2916e84937dd4e9bb7279470d48\": rpc error: code = NotFound desc = could not find container \"08a9723144fa0d176d1ad04ffafe6e3ef956e2916e84937dd4e9bb7279470d48\": container with ID starting with 08a9723144fa0d176d1ad04ffafe6e3ef956e2916e84937dd4e9bb7279470d48 not found: ID does not exist" Jul 28 16:38:00.708281 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:00.708261 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d797cdbc4-r2wjd"] Jul 28 16:38:00.713110 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:00.713091 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d797cdbc4-r2wjd"] Jul 28 16:38:01.052544 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:01.052504 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac9a931e-61a1-4476-9b76-8440065ecfd9" path="/var/lib/kubelet/pods/ac9a931e-61a1-4476-9b76-8440065ecfd9/volumes" Jul 28 16:38:21.090933 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:21.090895 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:21.161278 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:21.161243 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:21.794165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:21.794137 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:39.132296 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.132263 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 16:38:39.133330 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.133291 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="prometheus" containerID="cri-o://841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98" gracePeriod=600 Jul 28 16:38:39.134158 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.133502 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="kube-rbac-proxy-thanos" containerID="cri-o://97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482" gracePeriod=600 Jul 28 16:38:39.135452 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.133774 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="kube-rbac-proxy-web" containerID="cri-o://14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137" gracePeriod=600 Jul 28 16:38:39.135667 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.133793 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="kube-rbac-proxy" containerID="cri-o://d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2" gracePeriod=600 Jul 28 16:38:39.135869 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.133808 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="thanos-sidecar" containerID="cri-o://2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c" gracePeriod=600 Jul 28 16:38:39.137216 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.133821 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="config-reloader" containerID="cri-o://e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29" gracePeriod=600 Jul 28 16:38:39.390086 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.390027 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:39.539956 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.539919 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.539956 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.539963 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-grpc-tls\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540173 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.539988 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-serving-certs-ca-bundle\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540173 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540014 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-0\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540173 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540036 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-tls\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540173 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540160 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-2\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540384 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540215 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-web-config\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540384 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540244 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10a1dddc-8370-4960-96f4-1085b7a85f07-tls-assets\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540384 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540276 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-db\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540384 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540323 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-metrics-client-ca\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540384 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540350 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-thanos-prometheus-http-client-file\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540384 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540360 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:38:39.540672 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540420 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-metrics-client-certs\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540672 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540466 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-config\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540672 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540491 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-kube-rbac-proxy\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540672 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540516 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4g84\" (UniqueName: \"kubernetes.io/projected/10a1dddc-8370-4960-96f4-1085b7a85f07-kube-api-access-h4g84\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540672 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540540 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-trusted-ca-bundle\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540672 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540571 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-kubelet-serving-ca-bundle\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540672 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540596 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10a1dddc-8370-4960-96f4-1085b7a85f07-config-out\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540672 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540634 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-1\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.540672 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540669 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"10a1dddc-8370-4960-96f4-1085b7a85f07\" (UID: \"10a1dddc-8370-4960-96f4-1085b7a85f07\") " Jul 28 16:38:39.541124 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540708 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:38:39.541124 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540958 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.541124 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.540978 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.541481 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.541452 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:38:39.542358 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.542056 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:38:39.542671 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.542641 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:38:39.542899 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.542873 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:38:39.543521 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.543225 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:38:39.543521 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.543309 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:38:39.543667 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.543567 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:38:39.543667 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.543604 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:38:39.543803 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.543730 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:38:39.543963 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.543939 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:38:39.544085 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.544029 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10a1dddc-8370-4960-96f4-1085b7a85f07-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:38:39.544243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.544217 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:38:39.544997 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.544970 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10a1dddc-8370-4960-96f4-1085b7a85f07-kube-api-access-h4g84" (OuterVolumeSpecName: "kube-api-access-h4g84") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "kube-api-access-h4g84". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:38:39.545175 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.545151 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10a1dddc-8370-4960-96f4-1085b7a85f07-config-out" (OuterVolumeSpecName: "config-out") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:38:39.545536 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.545512 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:38:39.545792 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.545770 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:38:39.545872 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.545838 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-config" (OuterVolumeSpecName: "config") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:38:39.554039 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.554010 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-web-config" (OuterVolumeSpecName: "web-config") pod "10a1dddc-8370-4960-96f4-1085b7a85f07" (UID: "10a1dddc-8370-4960-96f4-1085b7a85f07"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:38:39.641871 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641795 2570 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-config\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.641871 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641821 2570 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-kube-rbac-proxy\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.641871 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641832 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4g84\" (UniqueName: \"kubernetes.io/projected/10a1dddc-8370-4960-96f4-1085b7a85f07-kube-api-access-h4g84\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.641871 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641842 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.641871 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641852 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.641871 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641860 2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10a1dddc-8370-4960-96f4-1085b7a85f07-config-out\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.641871 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641869 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.642174 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641877 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.642174 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641887 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.642174 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641896 2570 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-grpc-tls\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.642174 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641904 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.642174 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641912 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.642174 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641920 2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-web-config\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.642174 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641929 2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10a1dddc-8370-4960-96f4-1085b7a85f07-tls-assets\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.642174 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641936 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/10a1dddc-8370-4960-96f4-1085b7a85f07-prometheus-k8s-db\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.642174 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641943 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10a1dddc-8370-4960-96f4-1085b7a85f07-configmap-metrics-client-ca\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.642174 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641952 2570 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.642174 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.641960 2570 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/10a1dddc-8370-4960-96f4-1085b7a85f07-secret-metrics-client-certs\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:38:39.846449 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.846417 2570 generic.go:356] "Generic (PLEG): container finished" podID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerID="97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482" exitCode=0 Jul 28 16:38:39.846449 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.846443 2570 generic.go:356] "Generic (PLEG): container finished" podID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerID="d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2" exitCode=0 Jul 28 16:38:39.846449 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.846449 2570 generic.go:356] "Generic (PLEG): container finished" podID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerID="14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137" exitCode=0 Jul 28 16:38:39.846449 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.846456 2570 generic.go:356] "Generic (PLEG): container finished" podID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerID="2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c" exitCode=0 Jul 28 16:38:39.846704 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.846462 2570 generic.go:356] "Generic (PLEG): container finished" podID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerID="e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29" exitCode=0 Jul 28 16:38:39.846704 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.846468 2570 generic.go:356] "Generic (PLEG): container finished" podID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerID="841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98" exitCode=0 Jul 28 16:38:39.846704 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.846497 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:39.846704 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.846495 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10a1dddc-8370-4960-96f4-1085b7a85f07","Type":"ContainerDied","Data":"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482"} Jul 28 16:38:39.846704 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.846561 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10a1dddc-8370-4960-96f4-1085b7a85f07","Type":"ContainerDied","Data":"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2"} Jul 28 16:38:39.846704 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.846591 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10a1dddc-8370-4960-96f4-1085b7a85f07","Type":"ContainerDied","Data":"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137"} Jul 28 16:38:39.846704 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.846615 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10a1dddc-8370-4960-96f4-1085b7a85f07","Type":"ContainerDied","Data":"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c"} Jul 28 16:38:39.846704 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.846638 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10a1dddc-8370-4960-96f4-1085b7a85f07","Type":"ContainerDied","Data":"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29"} Jul 28 16:38:39.846704 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.846638 2570 scope.go:117] "RemoveContainer" containerID="97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482" Jul 28 16:38:39.846704 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.846662 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10a1dddc-8370-4960-96f4-1085b7a85f07","Type":"ContainerDied","Data":"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98"} Jul 28 16:38:39.846704 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.846686 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"10a1dddc-8370-4960-96f4-1085b7a85f07","Type":"ContainerDied","Data":"a1b327e4e4ab999497b0b9512c7c8158a931e35d1916d24ef7000aa4ac847415"} Jul 28 16:38:39.855068 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.855053 2570 scope.go:117] "RemoveContainer" containerID="d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2" Jul 28 16:38:39.861974 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.861956 2570 scope.go:117] "RemoveContainer" containerID="14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137" Jul 28 16:38:39.868760 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.868741 2570 scope.go:117] "RemoveContainer" containerID="2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c" Jul 28 16:38:39.870567 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.870545 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 16:38:39.874537 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.874514 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 16:38:39.876875 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.876855 2570 scope.go:117] "RemoveContainer" containerID="e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29" Jul 28 16:38:39.883576 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.883559 2570 scope.go:117] "RemoveContainer" containerID="841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98" Jul 28 16:38:39.890371 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.890357 2570 scope.go:117] "RemoveContainer" containerID="52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82" Jul 28 16:38:39.897064 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.897049 2570 scope.go:117] "RemoveContainer" containerID="97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482" Jul 28 16:38:39.897326 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:38:39.897302 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482\": container with ID starting with 97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482 not found: ID does not exist" containerID="97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482" Jul 28 16:38:39.897382 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.897328 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482"} err="failed to get container status \"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482\": rpc error: code = NotFound desc = could not find container \"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482\": container with ID starting with 97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482 not found: ID does not exist" Jul 28 16:38:39.897382 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.897345 2570 scope.go:117] "RemoveContainer" containerID="d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2" Jul 28 16:38:39.897603 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:38:39.897577 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2\": container with ID starting with d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2 not found: ID does not exist" containerID="d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2" Jul 28 16:38:39.897644 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.897611 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2"} err="failed to get container status \"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2\": rpc error: code = NotFound desc = could not find container \"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2\": container with ID starting with d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2 not found: ID does not exist" Jul 28 16:38:39.897644 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.897629 2570 scope.go:117] "RemoveContainer" containerID="14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137" Jul 28 16:38:39.897872 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:38:39.897856 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137\": container with ID starting with 14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137 not found: ID does not exist" containerID="14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137" Jul 28 16:38:39.897910 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.897878 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137"} err="failed to get container status \"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137\": rpc error: code = NotFound desc = could not find container \"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137\": container with ID starting with 14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137 not found: ID does not exist" Jul 28 16:38:39.897910 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.897891 2570 scope.go:117] "RemoveContainer" containerID="2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c" Jul 28 16:38:39.898133 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:38:39.898116 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c\": container with ID starting with 2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c not found: ID does not exist" containerID="2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c" Jul 28 16:38:39.898179 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.898138 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c"} err="failed to get container status \"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c\": rpc error: code = NotFound desc = could not find container \"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c\": container with ID starting with 2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c not found: ID does not exist" Jul 28 16:38:39.898179 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.898157 2570 scope.go:117] "RemoveContainer" containerID="e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29" Jul 28 16:38:39.898385 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:38:39.898371 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29\": container with ID starting with e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29 not found: ID does not exist" containerID="e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29" Jul 28 16:38:39.898427 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.898388 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29"} err="failed to get container status \"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29\": rpc error: code = NotFound desc = could not find container \"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29\": container with ID starting with e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29 not found: ID does not exist" Jul 28 16:38:39.898427 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.898400 2570 scope.go:117] "RemoveContainer" containerID="841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98" Jul 28 16:38:39.898591 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:38:39.898576 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98\": container with ID starting with 841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98 not found: ID does not exist" containerID="841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98" Jul 28 16:38:39.898625 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.898593 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98"} err="failed to get container status \"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98\": rpc error: code = NotFound desc = could not find container \"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98\": container with ID starting with 841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98 not found: ID does not exist" Jul 28 16:38:39.898625 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.898604 2570 scope.go:117] "RemoveContainer" containerID="52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82" Jul 28 16:38:39.898800 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:38:39.898780 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82\": container with ID starting with 52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82 not found: ID does not exist" containerID="52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82" Jul 28 16:38:39.898854 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.898807 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82"} err="failed to get container status \"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82\": rpc error: code = NotFound desc = could not find container \"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82\": container with ID starting with 52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82 not found: ID does not exist" Jul 28 16:38:39.898854 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.898826 2570 scope.go:117] "RemoveContainer" containerID="97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482" Jul 28 16:38:39.899061 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.899045 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482"} err="failed to get container status \"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482\": rpc error: code = NotFound desc = could not find container \"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482\": container with ID starting with 97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482 not found: ID does not exist" Jul 28 16:38:39.899101 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.899062 2570 scope.go:117] "RemoveContainer" containerID="d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2" Jul 28 16:38:39.899266 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.899250 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2"} err="failed to get container status \"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2\": rpc error: code = NotFound desc = could not find container \"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2\": container with ID starting with d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2 not found: ID does not exist" Jul 28 16:38:39.899316 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.899266 2570 scope.go:117] "RemoveContainer" containerID="14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137" Jul 28 16:38:39.899449 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.899433 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137"} err="failed to get container status \"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137\": rpc error: code = NotFound desc = could not find container \"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137\": container with ID starting with 14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137 not found: ID does not exist" Jul 28 16:38:39.899489 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.899450 2570 scope.go:117] "RemoveContainer" containerID="2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c" Jul 28 16:38:39.899678 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.899658 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c"} err="failed to get container status \"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c\": rpc error: code = NotFound desc = could not find container \"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c\": container with ID starting with 2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c not found: ID does not exist" Jul 28 16:38:39.899678 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.899677 2570 scope.go:117] "RemoveContainer" containerID="e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29" Jul 28 16:38:39.900029 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.900002 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29"} err="failed to get container status \"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29\": rpc error: code = NotFound desc = could not find container \"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29\": container with ID starting with e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29 not found: ID does not exist" Jul 28 16:38:39.900029 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.900045 2570 scope.go:117] "RemoveContainer" containerID="841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98" Jul 28 16:38:39.900575 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.900505 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98"} err="failed to get container status \"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98\": rpc error: code = NotFound desc = could not find container \"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98\": container with ID starting with 841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98 not found: ID does not exist" Jul 28 16:38:39.900575 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.900528 2570 scope.go:117] "RemoveContainer" containerID="52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82" Jul 28 16:38:39.900899 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.900869 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82"} err="failed to get container status \"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82\": rpc error: code = NotFound desc = could not find container \"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82\": container with ID starting with 52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82 not found: ID does not exist" Jul 28 16:38:39.900996 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.900900 2570 scope.go:117] "RemoveContainer" containerID="97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482" Jul 28 16:38:39.901150 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.901132 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482"} err="failed to get container status \"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482\": rpc error: code = NotFound desc = could not find container \"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482\": container with ID starting with 97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482 not found: ID does not exist" Jul 28 16:38:39.901204 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.901152 2570 scope.go:117] "RemoveContainer" containerID="d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2" Jul 28 16:38:39.901406 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.901389 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2"} err="failed to get container status \"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2\": rpc error: code = NotFound desc = could not find container \"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2\": container with ID starting with d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2 not found: ID does not exist" Jul 28 16:38:39.901480 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.901408 2570 scope.go:117] "RemoveContainer" containerID="14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137" Jul 28 16:38:39.901621 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.901603 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137"} err="failed to get container status \"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137\": rpc error: code = NotFound desc = could not find container \"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137\": container with ID starting with 14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137 not found: ID does not exist" Jul 28 16:38:39.901713 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.901622 2570 scope.go:117] "RemoveContainer" containerID="2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c" Jul 28 16:38:39.901865 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.901848 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 16:38:39.901865 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.901855 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c"} err="failed to get container status \"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c\": rpc error: code = NotFound desc = could not find container \"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c\": container with ID starting with 2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c not found: ID does not exist" Jul 28 16:38:39.901972 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.901873 2570 scope.go:117] "RemoveContainer" containerID="e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29" Jul 28 16:38:39.902137 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902118 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29"} err="failed to get container status \"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29\": rpc error: code = NotFound desc = could not find container \"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29\": container with ID starting with e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29 not found: ID does not exist" Jul 28 16:38:39.902182 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902139 2570 scope.go:117] "RemoveContainer" containerID="841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98" Jul 28 16:38:39.902216 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902190 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="kube-rbac-proxy-thanos" Jul 28 16:38:39.902216 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902203 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="kube-rbac-proxy-thanos" Jul 28 16:38:39.902216 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902212 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac9a931e-61a1-4476-9b76-8440065ecfd9" containerName="console" Jul 28 16:38:39.902327 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902217 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac9a931e-61a1-4476-9b76-8440065ecfd9" containerName="console" Jul 28 16:38:39.902327 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902230 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="init-config-reloader" Jul 28 16:38:39.902327 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902239 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="init-config-reloader" Jul 28 16:38:39.902327 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902246 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="thanos-sidecar" Jul 28 16:38:39.902327 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902254 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="thanos-sidecar" Jul 28 16:38:39.902327 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902268 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="config-reloader" Jul 28 16:38:39.902327 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902276 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="config-reloader" Jul 28 16:38:39.902327 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902286 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="kube-rbac-proxy-web" Jul 28 16:38:39.902327 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902292 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="kube-rbac-proxy-web" Jul 28 16:38:39.902327 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902305 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="prometheus" Jul 28 16:38:39.902327 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902311 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="prometheus" Jul 28 16:38:39.902327 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902321 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="kube-rbac-proxy" Jul 28 16:38:39.902327 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902326 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="kube-rbac-proxy" Jul 28 16:38:39.902818 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902349 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98"} err="failed to get container status \"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98\": rpc error: code = NotFound desc = could not find container \"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98\": container with ID starting with 841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98 not found: ID does not exist" Jul 28 16:38:39.902818 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902373 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="thanos-sidecar" Jul 28 16:38:39.902818 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902383 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac9a931e-61a1-4476-9b76-8440065ecfd9" containerName="console" Jul 28 16:38:39.902818 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902390 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="prometheus" Jul 28 16:38:39.902818 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902397 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="config-reloader" Jul 28 16:38:39.902818 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902404 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="kube-rbac-proxy" Jul 28 16:38:39.902818 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902409 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="kube-rbac-proxy-thanos" Jul 28 16:38:39.902818 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902414 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" containerName="kube-rbac-proxy-web" Jul 28 16:38:39.902818 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902365 2570 scope.go:117] "RemoveContainer" containerID="52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82" Jul 28 16:38:39.902818 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902660 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82"} err="failed to get container status \"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82\": rpc error: code = NotFound desc = could not find container \"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82\": container with ID starting with 52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82 not found: ID does not exist" Jul 28 16:38:39.902818 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902673 2570 scope.go:117] "RemoveContainer" containerID="97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482" Jul 28 16:38:39.903191 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902895 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482"} err="failed to get container status \"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482\": rpc error: code = NotFound desc = could not find container \"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482\": container with ID starting with 97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482 not found: ID does not exist" Jul 28 16:38:39.903191 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.902911 2570 scope.go:117] "RemoveContainer" containerID="d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2" Jul 28 16:38:39.903191 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.903117 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2"} err="failed to get container status \"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2\": rpc error: code = NotFound desc = could not find container \"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2\": container with ID starting with d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2 not found: ID does not exist" Jul 28 16:38:39.903191 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.903134 2570 scope.go:117] "RemoveContainer" containerID="14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137" Jul 28 16:38:39.903345 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.903331 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137"} err="failed to get container status \"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137\": rpc error: code = NotFound desc = could not find container \"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137\": container with ID starting with 14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137 not found: ID does not exist" Jul 28 16:38:39.903386 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.903348 2570 scope.go:117] "RemoveContainer" containerID="2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c" Jul 28 16:38:39.903613 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.903593 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c"} err="failed to get container status \"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c\": rpc error: code = NotFound desc = could not find container \"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c\": container with ID starting with 2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c not found: ID does not exist" Jul 28 16:38:39.903613 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.903612 2570 scope.go:117] "RemoveContainer" containerID="e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29" Jul 28 16:38:39.903896 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.903862 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29"} err="failed to get container status \"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29\": rpc error: code = NotFound desc = could not find container \"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29\": container with ID starting with e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29 not found: ID does not exist" Jul 28 16:38:39.903896 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.903880 2570 scope.go:117] "RemoveContainer" containerID="841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98" Jul 28 16:38:39.904105 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.904089 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98"} err="failed to get container status \"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98\": rpc error: code = NotFound desc = could not find container \"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98\": container with ID starting with 841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98 not found: ID does not exist" Jul 28 16:38:39.904145 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.904106 2570 scope.go:117] "RemoveContainer" containerID="52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82" Jul 28 16:38:39.904327 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.904310 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82"} err="failed to get container status \"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82\": rpc error: code = NotFound desc = could not find container \"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82\": container with ID starting with 52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82 not found: ID does not exist" Jul 28 16:38:39.904363 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.904337 2570 scope.go:117] "RemoveContainer" containerID="97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482" Jul 28 16:38:39.904568 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.904551 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482"} err="failed to get container status \"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482\": rpc error: code = NotFound desc = could not find container \"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482\": container with ID starting with 97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482 not found: ID does not exist" Jul 28 16:38:39.904610 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.904570 2570 scope.go:117] "RemoveContainer" containerID="d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2" Jul 28 16:38:39.904837 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.904818 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2"} err="failed to get container status \"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2\": rpc error: code = NotFound desc = could not find container \"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2\": container with ID starting with d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2 not found: ID does not exist" Jul 28 16:38:39.904895 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.904837 2570 scope.go:117] "RemoveContainer" containerID="14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137" Jul 28 16:38:39.905045 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.905027 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137"} err="failed to get container status \"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137\": rpc error: code = NotFound desc = could not find container \"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137\": container with ID starting with 14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137 not found: ID does not exist" Jul 28 16:38:39.905085 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.905047 2570 scope.go:117] "RemoveContainer" containerID="2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c" Jul 28 16:38:39.905269 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.905243 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c"} err="failed to get container status \"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c\": rpc error: code = NotFound desc = could not find container \"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c\": container with ID starting with 2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c not found: ID does not exist" Jul 28 16:38:39.905269 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.905267 2570 scope.go:117] "RemoveContainer" containerID="e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29" Jul 28 16:38:39.905501 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.905481 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29"} err="failed to get container status \"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29\": rpc error: code = NotFound desc = could not find container \"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29\": container with ID starting with e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29 not found: ID does not exist" Jul 28 16:38:39.905541 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.905504 2570 scope.go:117] "RemoveContainer" containerID="841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98" Jul 28 16:38:39.905746 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.905726 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98"} err="failed to get container status \"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98\": rpc error: code = NotFound desc = could not find container \"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98\": container with ID starting with 841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98 not found: ID does not exist" Jul 28 16:38:39.905797 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.905747 2570 scope.go:117] "RemoveContainer" containerID="52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82" Jul 28 16:38:39.905961 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.905942 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82"} err="failed to get container status \"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82\": rpc error: code = NotFound desc = could not find container \"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82\": container with ID starting with 52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82 not found: ID does not exist" Jul 28 16:38:39.906009 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.905963 2570 scope.go:117] "RemoveContainer" containerID="97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482" Jul 28 16:38:39.906184 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.906168 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482"} err="failed to get container status \"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482\": rpc error: code = NotFound desc = could not find container \"97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482\": container with ID starting with 97e3903adaad783d7184edbf1db48ff6ea27227dfcd4dceb40598124e430f482 not found: ID does not exist" Jul 28 16:38:39.906221 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.906185 2570 scope.go:117] "RemoveContainer" containerID="d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2" Jul 28 16:38:39.906413 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.906400 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:39.906459 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.906430 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2"} err="failed to get container status \"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2\": rpc error: code = NotFound desc = could not find container \"d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2\": container with ID starting with d5b0380b15668582cdcdddfb27edb2a4005e931f29c89c617f8a65fcd83837b2 not found: ID does not exist" Jul 28 16:38:39.906459 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.906446 2570 scope.go:117] "RemoveContainer" containerID="14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137" Jul 28 16:38:39.906701 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.906655 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137"} err="failed to get container status \"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137\": rpc error: code = NotFound desc = could not find container \"14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137\": container with ID starting with 14a8972a7c4b13b4f10aea5152db8da99a99135051fad88b8a52ad64befa5137 not found: ID does not exist" Jul 28 16:38:39.906810 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.906709 2570 scope.go:117] "RemoveContainer" containerID="2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c" Jul 28 16:38:39.907043 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.907020 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c"} err="failed to get container status \"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c\": rpc error: code = NotFound desc = could not find container \"2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c\": container with ID starting with 2d769314b9bf232860024c18f9702d8c2444c40f2cb32f6dac2d014054c7ed7c not found: ID does not exist" Jul 28 16:38:39.907108 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.907046 2570 scope.go:117] "RemoveContainer" containerID="e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29" Jul 28 16:38:39.907274 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.907255 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29"} err="failed to get container status \"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29\": rpc error: code = NotFound desc = could not find container \"e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29\": container with ID starting with e8a86b57d67586c2d0f508e0b49ac12394413b00f9625d0e85bbe888109e5e29 not found: ID does not exist" Jul 28 16:38:39.907335 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.907278 2570 scope.go:117] "RemoveContainer" containerID="841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98" Jul 28 16:38:39.907495 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.907474 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98"} err="failed to get container status \"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98\": rpc error: code = NotFound desc = could not find container \"841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98\": container with ID starting with 841aab60d9871855c5baa3e2b8bafa2f809ab786744d8d2952cb83b6c3347f98 not found: ID does not exist" Jul 28 16:38:39.907565 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.907498 2570 scope.go:117] "RemoveContainer" containerID="52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82" Jul 28 16:38:39.907785 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.907757 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82"} err="failed to get container status \"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82\": rpc error: code = NotFound desc = could not find container \"52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82\": container with ID starting with 52b437ca489bf6bd40df1168f19c34a75a5234a28c8758dc59c2d0679a703e82 not found: ID does not exist" Jul 28 16:38:39.908790 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.908773 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gt2sm\"" Jul 28 16:38:39.908865 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.908798 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 16:38:39.908865 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.908839 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 16:38:39.909099 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.909080 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 16:38:39.909099 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.909091 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 16:38:39.909238 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.909102 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 16:38:39.909238 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.909158 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 16:38:39.909238 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.909158 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 16:38:39.909388 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.909365 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 16:38:39.909388 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.909379 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 16:38:39.909815 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.909797 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 16:38:39.909897 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.909837 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1r8gmkm1gkmqc\"" Jul 28 16:38:39.909897 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.909797 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 16:38:39.910217 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.910202 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 16:38:39.910217 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.910210 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 16:38:39.913054 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.913034 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 16:38:39.916191 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.916172 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 16:38:39.921918 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:39.921895 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 16:38:40.045672 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.045629 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1aa1856-2588-4531-afee-4e434a96af17-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.045672 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.045672 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1aa1856-2588-4531-afee-4e434a96af17-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.045918 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.045717 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.045918 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.045785 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.045918 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.045842 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-config\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.045918 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.045868 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.045918 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.045899 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.046140 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.045923 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.046140 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.045956 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.046140 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.046012 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.046140 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.046052 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.046140 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.046075 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.046140 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.046094 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1aa1856-2588-4531-afee-4e434a96af17-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.046140 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.046107 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.046140 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.046128 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.046412 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.046168 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.046412 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.046204 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.046412 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.046221 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.046412 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.046255 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.046412 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.046273 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qqw4\" (UniqueName: \"kubernetes.io/projected/f1aa1856-2588-4531-afee-4e434a96af17-kube-api-access-5qqw4\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.147671 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.147590 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qqw4\" (UniqueName: \"kubernetes.io/projected/f1aa1856-2588-4531-afee-4e434a96af17-kube-api-access-5qqw4\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.147671 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.147638 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1aa1856-2588-4531-afee-4e434a96af17-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.147671 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.147657 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1aa1856-2588-4531-afee-4e434a96af17-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.148243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.147710 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.148243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.147749 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.148243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.147775 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-config\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.148243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.147795 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.148243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.147823 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.148243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.147845 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.148243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.147875 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.148243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.147905 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.148243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.147939 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.148243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.147973 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.148243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.147999 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1aa1856-2588-4531-afee-4e434a96af17-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.148243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.148021 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.148243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.148056 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.148243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.148062 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1aa1856-2588-4531-afee-4e434a96af17-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.148243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.148081 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.148243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.148118 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.148243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.148144 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.149434 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.148190 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.149434 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.148629 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.149531 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.149491 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.150082 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.150055 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.150603 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.150578 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1aa1856-2588-4531-afee-4e434a96af17-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.150722 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.150599 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.151034 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.151006 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.153236 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.151645 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.153236 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.151876 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.153236 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.151988 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1aa1856-2588-4531-afee-4e434a96af17-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.153236 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.152014 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.153236 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.152623 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.153236 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.152645 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.153649 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.153424 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.153649 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.153569 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1aa1856-2588-4531-afee-4e434a96af17-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.153878 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.153646 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.154088 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.153979 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.154778 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.154679 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.155305 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.155283 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1aa1856-2588-4531-afee-4e434a96af17-config\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.160181 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.160164 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qqw4\" (UniqueName: \"kubernetes.io/projected/f1aa1856-2588-4531-afee-4e434a96af17-kube-api-access-5qqw4\") pod \"prometheus-k8s-0\" (UID: \"f1aa1856-2588-4531-afee-4e434a96af17\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.217171 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.217139 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:38:40.354797 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.354766 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 16:38:40.358278 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:38:40.358251 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1aa1856_2588_4531_afee_4e434a96af17.slice/crio-389112f3ceb7b2aaca17795b81371479bf4884fd7c80aca86f9fd1ab56c63906 WatchSource:0}: Error finding container 389112f3ceb7b2aaca17795b81371479bf4884fd7c80aca86f9fd1ab56c63906: Status 404 returned error can't find the container with id 389112f3ceb7b2aaca17795b81371479bf4884fd7c80aca86f9fd1ab56c63906 Jul 28 16:38:40.853239 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.853208 2570 generic.go:356] "Generic (PLEG): container finished" podID="f1aa1856-2588-4531-afee-4e434a96af17" containerID="4614264fa093ce7a8ef83527a28987c28f721e875710ac6d0013fac79bd1647a" exitCode=0 Jul 28 16:38:40.853395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.853318 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1aa1856-2588-4531-afee-4e434a96af17","Type":"ContainerDied","Data":"4614264fa093ce7a8ef83527a28987c28f721e875710ac6d0013fac79bd1647a"} Jul 28 16:38:40.853395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:40.853382 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1aa1856-2588-4531-afee-4e434a96af17","Type":"ContainerStarted","Data":"389112f3ceb7b2aaca17795b81371479bf4884fd7c80aca86f9fd1ab56c63906"} Jul 28 16:38:41.059773 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:41.059019 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10a1dddc-8370-4960-96f4-1085b7a85f07" path="/var/lib/kubelet/pods/10a1dddc-8370-4960-96f4-1085b7a85f07/volumes" Jul 28 16:38:41.860905 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:41.860872 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1aa1856-2588-4531-afee-4e434a96af17","Type":"ContainerStarted","Data":"be421baffbdca3d6275acc5db8568d9344d68c60d9f41d793a3f1854d8f4efbe"} Jul 28 16:38:41.861289 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:41.860940 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1aa1856-2588-4531-afee-4e434a96af17","Type":"ContainerStarted","Data":"3a0cd7b8947b1f6dac8ad8b329a270e3e7bc6e8573b7e621794da8d16acb0dc3"} Jul 28 16:38:41.861289 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:41.860968 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1aa1856-2588-4531-afee-4e434a96af17","Type":"ContainerStarted","Data":"d755a7a038833230aee906e032e0f83ed3975a1d5fb438789556fac3300afbe2"} Jul 28 16:38:41.861289 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:41.861000 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1aa1856-2588-4531-afee-4e434a96af17","Type":"ContainerStarted","Data":"464e5651091dec70a0c9fbaf75bcfd1a6f6116f290a4dd8f1312be311b351251"} Jul 28 16:38:41.861289 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:41.861024 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1aa1856-2588-4531-afee-4e434a96af17","Type":"ContainerStarted","Data":"62643e65e9dc250f315ceafcb80a0cbde6dabb54da5910547801dfdf748e7667"} Jul 28 16:38:41.861289 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:41.861055 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1aa1856-2588-4531-afee-4e434a96af17","Type":"ContainerStarted","Data":"808b9ac5a35fa8f57e287aaa11bf0f67a38c56a3e051da3999cdacf9269cebfc"} Jul 28 16:38:41.895617 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:41.895553 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.875924122 podStartE2EDuration="2.895535689s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.611567ms" isStatefulPod=false podCreationTimestamp="2026-07-28 16:38:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:38:41.892862031 +0000 UTC m=+167.372410636" watchObservedRunningTime="2026-07-28 16:38:41.895535689 +0000 UTC m=+167.375084283" Jul 28 16:38:45.218091 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:38:45.218057 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:39:40.217614 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:39:40.217574 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:39:40.232992 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:39:40.232964 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:39:41.107287 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:39:41.107259 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 16:40:54.892929 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:40:54.892902 2570 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 16:41:16.086677 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.086642 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz"] Jul 28 16:41:16.088619 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.088604 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz" Jul 28 16:41:16.091233 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.091210 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 28 16:41:16.091359 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.091291 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-2mxql\"" Jul 28 16:41:16.091359 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.091300 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 28 16:41:16.092102 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.092082 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 28 16:41:16.092226 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.092073 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 28 16:41:16.098451 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.098431 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz"] Jul 28 16:41:16.208233 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.208200 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/6d2c7e3d-f706-4223-9b00-8fb9554491ec-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-f798f6db9-l5bfz\" (UID: \"6d2c7e3d-f706-4223-9b00-8fb9554491ec\") " pod="opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz" Jul 28 16:41:16.208392 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.208242 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgms2\" (UniqueName: \"kubernetes.io/projected/6d2c7e3d-f706-4223-9b00-8fb9554491ec-kube-api-access-kgms2\") pod \"kubeflow-trainer-controller-manager-f798f6db9-l5bfz\" (UID: \"6d2c7e3d-f706-4223-9b00-8fb9554491ec\") " pod="opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz" Jul 28 16:41:16.208392 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.208330 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d2c7e3d-f706-4223-9b00-8fb9554491ec-cert\") pod \"kubeflow-trainer-controller-manager-f798f6db9-l5bfz\" (UID: \"6d2c7e3d-f706-4223-9b00-8fb9554491ec\") " pod="opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz" Jul 28 16:41:16.309078 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.309032 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/6d2c7e3d-f706-4223-9b00-8fb9554491ec-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-f798f6db9-l5bfz\" (UID: \"6d2c7e3d-f706-4223-9b00-8fb9554491ec\") " pod="opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz" Jul 28 16:41:16.309240 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.309100 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgms2\" (UniqueName: \"kubernetes.io/projected/6d2c7e3d-f706-4223-9b00-8fb9554491ec-kube-api-access-kgms2\") pod \"kubeflow-trainer-controller-manager-f798f6db9-l5bfz\" (UID: \"6d2c7e3d-f706-4223-9b00-8fb9554491ec\") " pod="opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz" Jul 28 16:41:16.309240 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.309172 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d2c7e3d-f706-4223-9b00-8fb9554491ec-cert\") pod \"kubeflow-trainer-controller-manager-f798f6db9-l5bfz\" (UID: \"6d2c7e3d-f706-4223-9b00-8fb9554491ec\") " pod="opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz" Jul 28 16:41:16.309848 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.309824 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/6d2c7e3d-f706-4223-9b00-8fb9554491ec-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-f798f6db9-l5bfz\" (UID: \"6d2c7e3d-f706-4223-9b00-8fb9554491ec\") " pod="opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz" Jul 28 16:41:16.311564 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.311533 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d2c7e3d-f706-4223-9b00-8fb9554491ec-cert\") pod \"kubeflow-trainer-controller-manager-f798f6db9-l5bfz\" (UID: \"6d2c7e3d-f706-4223-9b00-8fb9554491ec\") " pod="opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz" Jul 28 16:41:16.317132 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.317110 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgms2\" (UniqueName: \"kubernetes.io/projected/6d2c7e3d-f706-4223-9b00-8fb9554491ec-kube-api-access-kgms2\") pod \"kubeflow-trainer-controller-manager-f798f6db9-l5bfz\" (UID: \"6d2c7e3d-f706-4223-9b00-8fb9554491ec\") " pod="opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz" Jul 28 16:41:16.398218 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.398133 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz" Jul 28 16:41:16.525073 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.525024 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz"] Jul 28 16:41:16.527250 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:41:16.527220 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d2c7e3d_f706_4223_9b00_8fb9554491ec.slice/crio-f135fc3875daa42845175eb36a0079b408fe99ec1f678b8ade2695848c629e13 WatchSource:0}: Error finding container f135fc3875daa42845175eb36a0079b408fe99ec1f678b8ade2695848c629e13: Status 404 returned error can't find the container with id f135fc3875daa42845175eb36a0079b408fe99ec1f678b8ade2695848c629e13 Jul 28 16:41:16.529162 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:16.529148 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 16:41:17.456265 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:17.456222 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz" event={"ID":"6d2c7e3d-f706-4223-9b00-8fb9554491ec","Type":"ContainerStarted","Data":"f135fc3875daa42845175eb36a0079b408fe99ec1f678b8ade2695848c629e13"} Jul 28 16:41:19.465176 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:19.465139 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz" event={"ID":"6d2c7e3d-f706-4223-9b00-8fb9554491ec","Type":"ContainerStarted","Data":"c5761282889eaf7a5f79b65f0fb936c08c5f3b37c190d3d996070e8e03a6ba31"} Jul 28 16:41:19.465592 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:19.465247 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz" Jul 28 16:41:19.483885 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:19.483842 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz" podStartSLOduration=1.204849097 podStartE2EDuration="3.483825993s" totalImagesPullingTime="2.278976896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:41:19.482048139 +0000 UTC m=+324.961596744" watchObservedRunningTime="2026-07-28 16:41:19.483825993 +0000 UTC m=+324.963374588" Jul 28 16:41:35.473560 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:41:35.473529 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-f798f6db9-l5bfz" Jul 28 16:42:38.721101 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:42:38.721061 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t"] Jul 28 16:42:38.723580 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:42:38.723561 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t" Jul 28 16:42:38.725821 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:42:38.725797 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-42db9\"/\"kube-root-ca.crt\"" Jul 28 16:42:38.725920 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:42:38.725864 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-42db9\"/\"default-dockercfg-dm2fx\"" Jul 28 16:42:38.725920 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:42:38.725864 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-42db9\"/\"openshift-service-ca.crt\"" Jul 28 16:42:38.733869 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:42:38.733847 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t"] Jul 28 16:42:38.822849 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:42:38.822817 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lf4v\" (UniqueName: \"kubernetes.io/projected/e2d66b4f-7978-4360-a418-4421c6d5a445-kube-api-access-2lf4v\") pod \"progression-enabled-node-0-0-lq56t\" (UID: \"e2d66b4f-7978-4360-a418-4421c6d5a445\") " pod="rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t" Jul 28 16:42:38.924256 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:42:38.924207 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lf4v\" (UniqueName: \"kubernetes.io/projected/e2d66b4f-7978-4360-a418-4421c6d5a445-kube-api-access-2lf4v\") pod \"progression-enabled-node-0-0-lq56t\" (UID: \"e2d66b4f-7978-4360-a418-4421c6d5a445\") " pod="rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t" Jul 28 16:42:38.932931 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:42:38.932904 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lf4v\" (UniqueName: \"kubernetes.io/projected/e2d66b4f-7978-4360-a418-4421c6d5a445-kube-api-access-2lf4v\") pod \"progression-enabled-node-0-0-lq56t\" (UID: \"e2d66b4f-7978-4360-a418-4421c6d5a445\") " pod="rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t" Jul 28 16:42:39.033944 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:42:39.033922 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t" Jul 28 16:42:39.163606 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:42:39.163502 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t"] Jul 28 16:42:39.166533 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:42:39.166497 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d66b4f_7978_4360_a418_4421c6d5a445.slice/crio-d79cb49478c11460e74a319cb6903d5fec162250a3f473e66afeb244e5e70896 WatchSource:0}: Error finding container d79cb49478c11460e74a319cb6903d5fec162250a3f473e66afeb244e5e70896: Status 404 returned error can't find the container with id d79cb49478c11460e74a319cb6903d5fec162250a3f473e66afeb244e5e70896 Jul 28 16:42:39.778506 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:42:39.778404 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t" event={"ID":"e2d66b4f-7978-4360-a418-4421c6d5a445","Type":"ContainerStarted","Data":"d79cb49478c11460e74a319cb6903d5fec162250a3f473e66afeb244e5e70896"} Jul 28 16:44:36.292393 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:44:36.292358 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t" event={"ID":"e2d66b4f-7978-4360-a418-4421c6d5a445","Type":"ContainerStarted","Data":"295225d04c9ef29aadf905ff9cfa01ad4ddeb950af009d1e11e27ccbcde32978"} Jul 28 16:44:36.292819 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:44:36.292467 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t" Jul 28 16:44:36.309782 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:44:36.309735 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t" podStartSLOduration=1.928695658 podStartE2EDuration="1m58.309719789s" totalImagesPullingTime="1m56.381024131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:42:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:44:36.307669732 +0000 UTC m=+521.787218326" watchObservedRunningTime="2026-07-28 16:44:36.309719789 +0000 UTC m=+521.789268469" Jul 28 16:44:37.295636 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:44:37.295608 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t" Jul 28 16:44:59.293255 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:44:59.293216 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t" podUID="e2d66b4f-7978-4360-a418-4421c6d5a445" containerName="node" probeResult="failure" output="Get \"http://10.134.0.23:28080/metrics\": dial tcp 10.134.0.23:28080: connect: connection refused" Jul 28 16:44:59.388983 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:44:59.388945 2570 generic.go:356] "Generic (PLEG): container finished" podID="e2d66b4f-7978-4360-a418-4421c6d5a445" containerID="295225d04c9ef29aadf905ff9cfa01ad4ddeb950af009d1e11e27ccbcde32978" exitCode=0 Jul 28 16:44:59.389149 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:44:59.388998 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t" event={"ID":"e2d66b4f-7978-4360-a418-4421c6d5a445","Type":"ContainerDied","Data":"295225d04c9ef29aadf905ff9cfa01ad4ddeb950af009d1e11e27ccbcde32978"} Jul 28 16:45:00.540855 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:00.540824 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t" Jul 28 16:45:00.598407 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:00.598369 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lf4v\" (UniqueName: \"kubernetes.io/projected/e2d66b4f-7978-4360-a418-4421c6d5a445-kube-api-access-2lf4v\") pod \"e2d66b4f-7978-4360-a418-4421c6d5a445\" (UID: \"e2d66b4f-7978-4360-a418-4421c6d5a445\") " Jul 28 16:45:00.600640 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:00.600602 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2d66b4f-7978-4360-a418-4421c6d5a445-kube-api-access-2lf4v" (OuterVolumeSpecName: "kube-api-access-2lf4v") pod "e2d66b4f-7978-4360-a418-4421c6d5a445" (UID: "e2d66b4f-7978-4360-a418-4421c6d5a445"). InnerVolumeSpecName "kube-api-access-2lf4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:45:00.700118 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:00.700030 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lf4v\" (UniqueName: \"kubernetes.io/projected/e2d66b4f-7978-4360-a418-4421c6d5a445-kube-api-access-2lf4v\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:45:01.398532 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:01.398444 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t" Jul 28 16:45:01.398532 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:01.398473 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t" event={"ID":"e2d66b4f-7978-4360-a418-4421c6d5a445","Type":"ContainerDied","Data":"d79cb49478c11460e74a319cb6903d5fec162250a3f473e66afeb244e5e70896"} Jul 28 16:45:01.398532 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:01.398522 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d79cb49478c11460e74a319cb6903d5fec162250a3f473e66afeb244e5e70896" Jul 28 16:45:03.252779 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:03.252744 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn"] Jul 28 16:45:03.253156 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:03.253075 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d66b4f-7978-4360-a418-4421c6d5a445" containerName="node" Jul 28 16:45:03.253156 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:03.253087 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d66b4f-7978-4360-a418-4421c6d5a445" containerName="node" Jul 28 16:45:03.253156 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:03.253150 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2d66b4f-7978-4360-a418-4421c6d5a445" containerName="node" Jul 28 16:45:03.269911 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:03.269877 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn"] Jul 28 16:45:03.270086 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:03.269979 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn" Jul 28 16:45:03.272673 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:03.272648 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-42db9\"/\"kube-root-ca.crt\"" Jul 28 16:45:03.272854 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:03.272648 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-42db9\"/\"openshift-service-ca.crt\"" Jul 28 16:45:03.272854 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:03.272648 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-42db9\"/\"default-dockercfg-dm2fx\"" Jul 28 16:45:03.321387 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:03.321346 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mx55\" (UniqueName: \"kubernetes.io/projected/1950952b-2b1a-4630-966e-3b66a26f5b9e-kube-api-access-7mx55\") pod \"progression-disabled-node-0-0-hj2cn\" (UID: \"1950952b-2b1a-4630-966e-3b66a26f5b9e\") " pod="rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn" Jul 28 16:45:03.422740 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:03.422677 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mx55\" (UniqueName: \"kubernetes.io/projected/1950952b-2b1a-4630-966e-3b66a26f5b9e-kube-api-access-7mx55\") pod \"progression-disabled-node-0-0-hj2cn\" (UID: \"1950952b-2b1a-4630-966e-3b66a26f5b9e\") " pod="rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn" Jul 28 16:45:03.431320 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:03.431286 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mx55\" (UniqueName: \"kubernetes.io/projected/1950952b-2b1a-4630-966e-3b66a26f5b9e-kube-api-access-7mx55\") pod \"progression-disabled-node-0-0-hj2cn\" (UID: \"1950952b-2b1a-4630-966e-3b66a26f5b9e\") " pod="rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn" Jul 28 16:45:03.580047 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:03.580011 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn" Jul 28 16:45:03.729776 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:03.729747 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn"] Jul 28 16:45:03.732504 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:45:03.732481 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1950952b_2b1a_4630_966e_3b66a26f5b9e.slice/crio-2102b11e525bb994938695e6b287d110c0d19c3261566f0dc3e04180f94a520e WatchSource:0}: Error finding container 2102b11e525bb994938695e6b287d110c0d19c3261566f0dc3e04180f94a520e: Status 404 returned error can't find the container with id 2102b11e525bb994938695e6b287d110c0d19c3261566f0dc3e04180f94a520e Jul 28 16:45:04.413141 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:04.413111 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn" event={"ID":"1950952b-2b1a-4630-966e-3b66a26f5b9e","Type":"ContainerStarted","Data":"07aebdb87bda05bbe6ca6a5e860641a6c8fc5a3fa1f772ad2bb80390d5caf0a9"} Jul 28 16:45:04.413141 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:04.413157 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn" event={"ID":"1950952b-2b1a-4630-966e-3b66a26f5b9e","Type":"ContainerStarted","Data":"2102b11e525bb994938695e6b287d110c0d19c3261566f0dc3e04180f94a520e"} Jul 28 16:45:04.413636 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:04.413179 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn" Jul 28 16:45:04.430809 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:04.430759 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn" podStartSLOduration=1.430739975 podStartE2EDuration="1.430739975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:45:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:45:04.429436396 +0000 UTC m=+549.908984992" watchObservedRunningTime="2026-07-28 16:45:04.430739975 +0000 UTC m=+549.910288569" Jul 28 16:45:05.416280 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:05.416253 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn" Jul 28 16:45:27.413852 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:27.413802 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn" podUID="1950952b-2b1a-4630-966e-3b66a26f5b9e" containerName="node" probeResult="failure" output="Get \"http://10.134.0.24:28080/metrics\": dial tcp 10.134.0.24:28080: connect: connection refused" Jul 28 16:45:27.506116 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:27.506084 2570 generic.go:356] "Generic (PLEG): container finished" podID="1950952b-2b1a-4630-966e-3b66a26f5b9e" containerID="07aebdb87bda05bbe6ca6a5e860641a6c8fc5a3fa1f772ad2bb80390d5caf0a9" exitCode=0 Jul 28 16:45:27.506387 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:27.506161 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn" event={"ID":"1950952b-2b1a-4630-966e-3b66a26f5b9e","Type":"ContainerDied","Data":"07aebdb87bda05bbe6ca6a5e860641a6c8fc5a3fa1f772ad2bb80390d5caf0a9"} Jul 28 16:45:28.642669 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:28.642645 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn" Jul 28 16:45:28.736335 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:28.736303 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mx55\" (UniqueName: \"kubernetes.io/projected/1950952b-2b1a-4630-966e-3b66a26f5b9e-kube-api-access-7mx55\") pod \"1950952b-2b1a-4630-966e-3b66a26f5b9e\" (UID: \"1950952b-2b1a-4630-966e-3b66a26f5b9e\") " Jul 28 16:45:28.738361 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:28.738329 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1950952b-2b1a-4630-966e-3b66a26f5b9e-kube-api-access-7mx55" (OuterVolumeSpecName: "kube-api-access-7mx55") pod "1950952b-2b1a-4630-966e-3b66a26f5b9e" (UID: "1950952b-2b1a-4630-966e-3b66a26f5b9e"). InnerVolumeSpecName "kube-api-access-7mx55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:45:28.837592 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:28.837558 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mx55\" (UniqueName: \"kubernetes.io/projected/1950952b-2b1a-4630-966e-3b66a26f5b9e-kube-api-access-7mx55\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:45:29.517415 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:29.517372 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn" event={"ID":"1950952b-2b1a-4630-966e-3b66a26f5b9e","Type":"ContainerDied","Data":"2102b11e525bb994938695e6b287d110c0d19c3261566f0dc3e04180f94a520e"} Jul 28 16:45:29.517629 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:29.517472 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2102b11e525bb994938695e6b287d110c0d19c3261566f0dc3e04180f94a520e" Jul 28 16:45:29.517629 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:29.517561 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn" Jul 28 16:45:38.243054 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:38.243020 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw"] Jul 28 16:45:38.243512 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:38.243330 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1950952b-2b1a-4630-966e-3b66a26f5b9e" containerName="node" Jul 28 16:45:38.243512 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:38.243340 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1950952b-2b1a-4630-966e-3b66a26f5b9e" containerName="node" Jul 28 16:45:38.243512 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:38.243406 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1950952b-2b1a-4630-966e-3b66a26f5b9e" containerName="node" Jul 28 16:45:38.245355 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:38.245337 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" Jul 28 16:45:38.247733 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:38.247711 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-42db9\"/\"kube-root-ca.crt\"" Jul 28 16:45:38.247830 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:38.247757 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-42db9\"/\"default-dockercfg-dm2fx\"" Jul 28 16:45:38.247874 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:38.247850 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-42db9\"/\"openshift-service-ca.crt\"" Jul 28 16:45:38.258115 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:38.258093 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw"] Jul 28 16:45:38.313141 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:38.313109 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pcnl\" (UniqueName: \"kubernetes.io/projected/86672bfb-9ead-438f-a5e6-39ba4a8d34dd-kube-api-access-4pcnl\") pod \"progression-invalid-node-0-0-85snw\" (UID: \"86672bfb-9ead-438f-a5e6-39ba4a8d34dd\") " pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" Jul 28 16:45:38.414052 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:38.414017 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pcnl\" (UniqueName: \"kubernetes.io/projected/86672bfb-9ead-438f-a5e6-39ba4a8d34dd-kube-api-access-4pcnl\") pod \"progression-invalid-node-0-0-85snw\" (UID: \"86672bfb-9ead-438f-a5e6-39ba4a8d34dd\") " pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" Jul 28 16:45:38.421919 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:38.421883 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pcnl\" (UniqueName: \"kubernetes.io/projected/86672bfb-9ead-438f-a5e6-39ba4a8d34dd-kube-api-access-4pcnl\") pod \"progression-invalid-node-0-0-85snw\" (UID: \"86672bfb-9ead-438f-a5e6-39ba4a8d34dd\") " pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" Jul 28 16:45:38.553839 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:38.553810 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" Jul 28 16:45:38.682398 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:38.682375 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw"] Jul 28 16:45:38.684998 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:45:38.684971 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86672bfb_9ead_438f_a5e6_39ba4a8d34dd.slice/crio-77eacbe8b84f4d9ae792287fc61d9e2b3686eb114634d894a04f01d48b726f40 WatchSource:0}: Error finding container 77eacbe8b84f4d9ae792287fc61d9e2b3686eb114634d894a04f01d48b726f40: Status 404 returned error can't find the container with id 77eacbe8b84f4d9ae792287fc61d9e2b3686eb114634d894a04f01d48b726f40 Jul 28 16:45:39.558196 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:39.558156 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" event={"ID":"86672bfb-9ead-438f-a5e6-39ba4a8d34dd","Type":"ContainerStarted","Data":"2961696b63df4ed7edbf4eb11def7ff868e4009ef600762face2fc9ce0ef8271"} Jul 28 16:45:39.558196 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:39.558199 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" event={"ID":"86672bfb-9ead-438f-a5e6-39ba4a8d34dd","Type":"ContainerStarted","Data":"77eacbe8b84f4d9ae792287fc61d9e2b3686eb114634d894a04f01d48b726f40"} Jul 28 16:45:39.558778 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:39.558242 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" Jul 28 16:45:39.574243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:39.574187 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" podStartSLOduration=1.574170016 podStartE2EDuration="1.574170016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:45:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:45:39.573776543 +0000 UTC m=+585.053325161" watchObservedRunningTime="2026-07-28 16:45:39.574170016 +0000 UTC m=+585.053718612" Jul 28 16:45:40.561523 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:45:40.561497 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" Jul 28 16:46:01.821515 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:46:01.821468 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" podUID="86672bfb-9ead-438f-a5e6-39ba4a8d34dd" containerName="node" probeResult="failure" output="Get \"http://10.134.0.25:28080/metrics\": read tcp 10.134.0.2:37098->10.134.0.25:28080: read: connection reset by peer" Jul 28 16:46:02.559082 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:46:02.559039 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" podUID="86672bfb-9ead-438f-a5e6-39ba4a8d34dd" containerName="node" probeResult="failure" output="Get \"http://10.134.0.25:28080/metrics\": dial tcp 10.134.0.25:28080: connect: connection refused" Jul 28 16:46:02.559275 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:46:02.559160 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" Jul 28 16:46:02.559583 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:46:02.559553 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" podUID="86672bfb-9ead-438f-a5e6-39ba4a8d34dd" containerName="node" probeResult="failure" output="Get \"http://10.134.0.25:28080/metrics\": dial tcp 10.134.0.25:28080: connect: connection refused" Jul 28 16:46:02.666542 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:46:02.666510 2570 generic.go:356] "Generic (PLEG): container finished" podID="86672bfb-9ead-438f-a5e6-39ba4a8d34dd" containerID="2961696b63df4ed7edbf4eb11def7ff868e4009ef600762face2fc9ce0ef8271" exitCode=0 Jul 28 16:46:02.666758 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:46:02.666590 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" event={"ID":"86672bfb-9ead-438f-a5e6-39ba4a8d34dd","Type":"ContainerDied","Data":"2961696b63df4ed7edbf4eb11def7ff868e4009ef600762face2fc9ce0ef8271"} Jul 28 16:46:03.797086 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:46:03.797061 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" Jul 28 16:46:03.934621 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:46:03.934537 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pcnl\" (UniqueName: \"kubernetes.io/projected/86672bfb-9ead-438f-a5e6-39ba4a8d34dd-kube-api-access-4pcnl\") pod \"86672bfb-9ead-438f-a5e6-39ba4a8d34dd\" (UID: \"86672bfb-9ead-438f-a5e6-39ba4a8d34dd\") " Jul 28 16:46:03.936543 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:46:03.936514 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86672bfb-9ead-438f-a5e6-39ba4a8d34dd-kube-api-access-4pcnl" (OuterVolumeSpecName: "kube-api-access-4pcnl") pod "86672bfb-9ead-438f-a5e6-39ba4a8d34dd" (UID: "86672bfb-9ead-438f-a5e6-39ba4a8d34dd"). InnerVolumeSpecName "kube-api-access-4pcnl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:46:04.035243 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:46:04.035213 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pcnl\" (UniqueName: \"kubernetes.io/projected/86672bfb-9ead-438f-a5e6-39ba4a8d34dd-kube-api-access-4pcnl\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:46:04.677324 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:46:04.677294 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" Jul 28 16:46:04.677324 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:46:04.677309 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw" event={"ID":"86672bfb-9ead-438f-a5e6-39ba4a8d34dd","Type":"ContainerDied","Data":"77eacbe8b84f4d9ae792287fc61d9e2b3686eb114634d894a04f01d48b726f40"} Jul 28 16:46:04.677587 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:46:04.677348 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77eacbe8b84f4d9ae792287fc61d9e2b3686eb114634d894a04f01d48b726f40" Jul 28 16:47:49.866299 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:49.866219 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-42db9/progression-no-metrics-node-0-0-sbx7z"] Jul 28 16:47:49.867547 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:49.866545 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86672bfb-9ead-438f-a5e6-39ba4a8d34dd" containerName="node" Jul 28 16:47:49.867547 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:49.866556 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="86672bfb-9ead-438f-a5e6-39ba4a8d34dd" containerName="node" Jul 28 16:47:49.867547 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:49.866614 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="86672bfb-9ead-438f-a5e6-39ba4a8d34dd" containerName="node" Jul 28 16:47:49.868438 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:49.868422 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-no-metrics-node-0-0-sbx7z" Jul 28 16:47:49.870698 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:49.870672 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-42db9\"/\"kube-root-ca.crt\"" Jul 28 16:47:49.871531 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:49.871515 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-42db9\"/\"openshift-service-ca.crt\"" Jul 28 16:47:49.871608 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:49.871570 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-42db9\"/\"default-dockercfg-dm2fx\"" Jul 28 16:47:49.878785 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:49.878762 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-42db9/progression-no-metrics-node-0-0-sbx7z"] Jul 28 16:47:50.030627 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:50.030591 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmw55\" (UniqueName: \"kubernetes.io/projected/8c4a685f-5c59-4785-9f3a-b067a7d0dbc0-kube-api-access-mmw55\") pod \"progression-no-metrics-node-0-0-sbx7z\" (UID: \"8c4a685f-5c59-4785-9f3a-b067a7d0dbc0\") " pod="rhai-e2e-progression-42db9/progression-no-metrics-node-0-0-sbx7z" Jul 28 16:47:50.131878 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:50.131797 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmw55\" (UniqueName: \"kubernetes.io/projected/8c4a685f-5c59-4785-9f3a-b067a7d0dbc0-kube-api-access-mmw55\") pod \"progression-no-metrics-node-0-0-sbx7z\" (UID: \"8c4a685f-5c59-4785-9f3a-b067a7d0dbc0\") " pod="rhai-e2e-progression-42db9/progression-no-metrics-node-0-0-sbx7z" Jul 28 16:47:50.140147 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:50.140113 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmw55\" (UniqueName: \"kubernetes.io/projected/8c4a685f-5c59-4785-9f3a-b067a7d0dbc0-kube-api-access-mmw55\") pod \"progression-no-metrics-node-0-0-sbx7z\" (UID: \"8c4a685f-5c59-4785-9f3a-b067a7d0dbc0\") " pod="rhai-e2e-progression-42db9/progression-no-metrics-node-0-0-sbx7z" Jul 28 16:47:50.178079 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:50.178046 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-no-metrics-node-0-0-sbx7z" Jul 28 16:47:50.304949 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:50.304922 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-42db9/progression-no-metrics-node-0-0-sbx7z"] Jul 28 16:47:50.306966 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:47:50.306927 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c4a685f_5c59_4785_9f3a_b067a7d0dbc0.slice/crio-fec29084dbedef932a23078ed235920851af3ff60f39778981783945b0ec3e5e WatchSource:0}: Error finding container fec29084dbedef932a23078ed235920851af3ff60f39778981783945b0ec3e5e: Status 404 returned error can't find the container with id fec29084dbedef932a23078ed235920851af3ff60f39778981783945b0ec3e5e Jul 28 16:47:51.140984 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:51.140947 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-no-metrics-node-0-0-sbx7z" event={"ID":"8c4a685f-5c59-4785-9f3a-b067a7d0dbc0","Type":"ContainerStarted","Data":"8d50213fb42a39f470f7ef863abaf11b56228bab56bfc6a510b1ef4037844e00"} Jul 28 16:47:51.141385 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:51.140998 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-no-metrics-node-0-0-sbx7z" event={"ID":"8c4a685f-5c59-4785-9f3a-b067a7d0dbc0","Type":"ContainerStarted","Data":"fec29084dbedef932a23078ed235920851af3ff60f39778981783945b0ec3e5e"} Jul 28 16:47:51.164988 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:51.164938 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-42db9/progression-no-metrics-node-0-0-sbx7z" podStartSLOduration=2.164921144 podStartE2EDuration="2.164921144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:47:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:47:51.164288675 +0000 UTC m=+716.643837271" watchObservedRunningTime="2026-07-28 16:47:51.164921144 +0000 UTC m=+716.644469738" Jul 28 16:47:56.163083 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:56.163049 2570 generic.go:356] "Generic (PLEG): container finished" podID="8c4a685f-5c59-4785-9f3a-b067a7d0dbc0" containerID="8d50213fb42a39f470f7ef863abaf11b56228bab56bfc6a510b1ef4037844e00" exitCode=0 Jul 28 16:47:56.163480 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:56.163120 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-no-metrics-node-0-0-sbx7z" event={"ID":"8c4a685f-5c59-4785-9f3a-b067a7d0dbc0","Type":"ContainerDied","Data":"8d50213fb42a39f470f7ef863abaf11b56228bab56bfc6a510b1ef4037844e00"} Jul 28 16:47:57.294101 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:57.294077 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-no-metrics-node-0-0-sbx7z" Jul 28 16:47:57.394787 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:57.394755 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmw55\" (UniqueName: \"kubernetes.io/projected/8c4a685f-5c59-4785-9f3a-b067a7d0dbc0-kube-api-access-mmw55\") pod \"8c4a685f-5c59-4785-9f3a-b067a7d0dbc0\" (UID: \"8c4a685f-5c59-4785-9f3a-b067a7d0dbc0\") " Jul 28 16:47:57.396785 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:57.396753 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c4a685f-5c59-4785-9f3a-b067a7d0dbc0-kube-api-access-mmw55" (OuterVolumeSpecName: "kube-api-access-mmw55") pod "8c4a685f-5c59-4785-9f3a-b067a7d0dbc0" (UID: "8c4a685f-5c59-4785-9f3a-b067a7d0dbc0"). InnerVolumeSpecName "kube-api-access-mmw55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:47:57.496360 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:57.496276 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmw55\" (UniqueName: \"kubernetes.io/projected/8c4a685f-5c59-4785-9f3a-b067a7d0dbc0-kube-api-access-mmw55\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:47:58.174374 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:58.174345 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-no-metrics-node-0-0-sbx7z" Jul 28 16:47:58.174547 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:58.174384 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-no-metrics-node-0-0-sbx7z" event={"ID":"8c4a685f-5c59-4785-9f3a-b067a7d0dbc0","Type":"ContainerDied","Data":"fec29084dbedef932a23078ed235920851af3ff60f39778981783945b0ec3e5e"} Jul 28 16:47:58.174547 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:47:58.174425 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fec29084dbedef932a23078ed235920851af3ff60f39778981783945b0ec3e5e" Jul 28 16:48:02.763445 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:02.763407 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7grst/must-gather-2svq2"] Jul 28 16:48:02.763890 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:02.763743 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c4a685f-5c59-4785-9f3a-b067a7d0dbc0" containerName="node" Jul 28 16:48:02.763890 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:02.763755 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c4a685f-5c59-4785-9f3a-b067a7d0dbc0" containerName="node" Jul 28 16:48:02.763890 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:02.763825 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c4a685f-5c59-4785-9f3a-b067a7d0dbc0" containerName="node" Jul 28 16:48:02.766001 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:02.765984 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7grst/must-gather-2svq2" Jul 28 16:48:02.768653 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:02.768634 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7grst\"/\"openshift-service-ca.crt\"" Jul 28 16:48:02.768804 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:02.768660 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7grst\"/\"kube-root-ca.crt\"" Jul 28 16:48:02.769708 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:02.769681 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7grst\"/\"default-dockercfg-qmms2\"" Jul 28 16:48:02.778764 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:02.778745 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7grst/must-gather-2svq2"] Jul 28 16:48:02.944362 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:02.944324 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ea668d63-5bc8-4f62-8a0c-c901c191f471-must-gather-output\") pod \"must-gather-2svq2\" (UID: \"ea668d63-5bc8-4f62-8a0c-c901c191f471\") " pod="openshift-must-gather-7grst/must-gather-2svq2" Jul 28 16:48:02.944539 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:02.944439 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkthl\" (UniqueName: \"kubernetes.io/projected/ea668d63-5bc8-4f62-8a0c-c901c191f471-kube-api-access-kkthl\") pod \"must-gather-2svq2\" (UID: \"ea668d63-5bc8-4f62-8a0c-c901c191f471\") " pod="openshift-must-gather-7grst/must-gather-2svq2" Jul 28 16:48:03.045727 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:03.045670 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ea668d63-5bc8-4f62-8a0c-c901c191f471-must-gather-output\") pod \"must-gather-2svq2\" (UID: \"ea668d63-5bc8-4f62-8a0c-c901c191f471\") " pod="openshift-must-gather-7grst/must-gather-2svq2" Jul 28 16:48:03.045880 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:03.045798 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkthl\" (UniqueName: \"kubernetes.io/projected/ea668d63-5bc8-4f62-8a0c-c901c191f471-kube-api-access-kkthl\") pod \"must-gather-2svq2\" (UID: \"ea668d63-5bc8-4f62-8a0c-c901c191f471\") " pod="openshift-must-gather-7grst/must-gather-2svq2" Jul 28 16:48:03.046028 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:03.046008 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ea668d63-5bc8-4f62-8a0c-c901c191f471-must-gather-output\") pod \"must-gather-2svq2\" (UID: \"ea668d63-5bc8-4f62-8a0c-c901c191f471\") " pod="openshift-must-gather-7grst/must-gather-2svq2" Jul 28 16:48:03.055931 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:03.055907 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkthl\" (UniqueName: \"kubernetes.io/projected/ea668d63-5bc8-4f62-8a0c-c901c191f471-kube-api-access-kkthl\") pod \"must-gather-2svq2\" (UID: \"ea668d63-5bc8-4f62-8a0c-c901c191f471\") " pod="openshift-must-gather-7grst/must-gather-2svq2" Jul 28 16:48:03.074836 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:03.074805 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7grst/must-gather-2svq2" Jul 28 16:48:03.206197 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:03.206154 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7grst/must-gather-2svq2"] Jul 28 16:48:03.208423 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:48:03.208397 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea668d63_5bc8_4f62_8a0c_c901c191f471.slice/crio-d5f4391cfca954f92231e07081168726bf9e0b0de8040fbbad8e6d58730b6ece WatchSource:0}: Error finding container d5f4391cfca954f92231e07081168726bf9e0b0de8040fbbad8e6d58730b6ece: Status 404 returned error can't find the container with id d5f4391cfca954f92231e07081168726bf9e0b0de8040fbbad8e6d58730b6ece Jul 28 16:48:03.210199 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:03.210180 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 16:48:04.212527 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:04.212490 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7grst/must-gather-2svq2" event={"ID":"ea668d63-5bc8-4f62-8a0c-c901c191f471","Type":"ContainerStarted","Data":"d5f4391cfca954f92231e07081168726bf9e0b0de8040fbbad8e6d58730b6ece"} Jul 28 16:48:06.962786 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:06.962747 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn"] Jul 28 16:48:06.968855 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:06.968824 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-42db9/progression-disabled-node-0-0-hj2cn"] Jul 28 16:48:06.973875 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:06.973849 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t"] Jul 28 16:48:06.977898 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:06.977871 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-42db9/progression-enabled-node-0-0-lq56t"] Jul 28 16:48:06.981655 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:06.981635 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw"] Jul 28 16:48:06.985335 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:06.985315 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-42db9/progression-invalid-node-0-0-85snw"] Jul 28 16:48:07.001311 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:07.001286 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-42db9/progression-no-metrics-node-0-0-sbx7z"] Jul 28 16:48:07.004860 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:07.004838 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-42db9/progression-no-metrics-node-0-0-sbx7z"] Jul 28 16:48:07.053725 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:07.053677 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1950952b-2b1a-4630-966e-3b66a26f5b9e" path="/var/lib/kubelet/pods/1950952b-2b1a-4630-966e-3b66a26f5b9e/volumes" Jul 28 16:48:07.054034 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:07.054019 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86672bfb-9ead-438f-a5e6-39ba4a8d34dd" path="/var/lib/kubelet/pods/86672bfb-9ead-438f-a5e6-39ba4a8d34dd/volumes" Jul 28 16:48:07.054307 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:07.054294 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c4a685f-5c59-4785-9f3a-b067a7d0dbc0" path="/var/lib/kubelet/pods/8c4a685f-5c59-4785-9f3a-b067a7d0dbc0/volumes" Jul 28 16:48:07.054665 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:07.054638 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2d66b4f-7978-4360-a418-4421c6d5a445" path="/var/lib/kubelet/pods/e2d66b4f-7978-4360-a418-4421c6d5a445/volumes" Jul 28 16:48:10.253523 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:10.253488 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7grst/must-gather-2svq2" event={"ID":"ea668d63-5bc8-4f62-8a0c-c901c191f471","Type":"ContainerStarted","Data":"51b1ac9dc40d6400427073e50683a99e2f28576340785025d6b04e570bbee4f8"} Jul 28 16:48:10.253941 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:10.253537 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7grst/must-gather-2svq2" event={"ID":"ea668d63-5bc8-4f62-8a0c-c901c191f471","Type":"ContainerStarted","Data":"c11126c3f25d3fc921a35ae77f86b1231e080adde811c30177350858fa2948d8"} Jul 28 16:48:10.269380 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:10.269316 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7grst/must-gather-2svq2" podStartSLOduration=2.28688097 podStartE2EDuration="8.269294176s" totalImagesPullingTime="5.982413206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:48:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:48:10.268807174 +0000 UTC m=+735.748355768" watchObservedRunningTime="2026-07-28 16:48:10.269294176 +0000 UTC m=+735.748842772" Jul 28 16:48:19.007776 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:19.007743 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-f798f6db9-l5bfz_6d2c7e3d-f706-4223-9b00-8fb9554491ec/manager/0.log" Jul 28 16:48:19.478219 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:19.478182 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-f798f6db9-l5bfz_6d2c7e3d-f706-4223-9b00-8fb9554491ec/manager/0.log" Jul 28 16:48:19.958195 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:19.958162 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-f798f6db9-l5bfz_6d2c7e3d-f706-4223-9b00-8fb9554491ec/manager/0.log" Jul 28 16:48:56.491258 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:56.491222 2570 generic.go:356] "Generic (PLEG): container finished" podID="ea668d63-5bc8-4f62-8a0c-c901c191f471" containerID="c11126c3f25d3fc921a35ae77f86b1231e080adde811c30177350858fa2948d8" exitCode=0 Jul 28 16:48:56.491258 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:56.491262 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7grst/must-gather-2svq2" event={"ID":"ea668d63-5bc8-4f62-8a0c-c901c191f471","Type":"ContainerDied","Data":"c11126c3f25d3fc921a35ae77f86b1231e080adde811c30177350858fa2948d8"} Jul 28 16:48:56.491742 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:56.491565 2570 scope.go:117] "RemoveContainer" containerID="c11126c3f25d3fc921a35ae77f86b1231e080adde811c30177350858fa2948d8" Jul 28 16:48:56.755197 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:56.755117 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7grst_must-gather-2svq2_ea668d63-5bc8-4f62-8a0c-c901c191f471/gather/0.log" Jul 28 16:48:59.889873 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:59.889845 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qfctx_c8b7d602-7f06-4c32-85e7-fd711dcf48ef/global-pull-secret-syncer/0.log" Jul 28 16:48:59.997990 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:48:59.997957 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tv4dg_3764a6ab-bd08-4d46-a39a-0b491e8e08d6/konnectivity-agent/0.log" Jul 28 16:49:00.076411 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:00.076380 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-117.ec2.internal_dc19e62a3119df3b706b9f3232a5ea75/haproxy/0.log" Jul 28 16:49:02.097543 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.097510 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-7grst/must-gather-2svq2"] Jul 28 16:49:02.098103 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.097717 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-7grst/must-gather-2svq2" podUID="ea668d63-5bc8-4f62-8a0c-c901c191f471" containerName="copy" containerID="cri-o://51b1ac9dc40d6400427073e50683a99e2f28576340785025d6b04e570bbee4f8" gracePeriod=2 Jul 28 16:49:02.102258 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.102232 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-7grst/must-gather-2svq2"] Jul 28 16:49:02.329629 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.329609 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7grst_must-gather-2svq2_ea668d63-5bc8-4f62-8a0c-c901c191f471/copy/0.log" Jul 28 16:49:02.332366 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.332349 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7grst/must-gather-2svq2" Jul 28 16:49:02.334317 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:49:02.334292 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-2svq2\" is forbidden: User \"system:node:ip-10-0-140-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7grst\": no relationship found between node 'ip-10-0-140-117.ec2.internal' and this object" podUID="ea668d63-5bc8-4f62-8a0c-c901c191f471" pod="openshift-must-gather-7grst/must-gather-2svq2" Jul 28 16:49:02.360614 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.360550 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkthl\" (UniqueName: \"kubernetes.io/projected/ea668d63-5bc8-4f62-8a0c-c901c191f471-kube-api-access-kkthl\") pod \"ea668d63-5bc8-4f62-8a0c-c901c191f471\" (UID: \"ea668d63-5bc8-4f62-8a0c-c901c191f471\") " Jul 28 16:49:02.360725 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.360659 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ea668d63-5bc8-4f62-8a0c-c901c191f471-must-gather-output\") pod \"ea668d63-5bc8-4f62-8a0c-c901c191f471\" (UID: \"ea668d63-5bc8-4f62-8a0c-c901c191f471\") " Jul 28 16:49:02.362782 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.362750 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea668d63-5bc8-4f62-8a0c-c901c191f471-kube-api-access-kkthl" (OuterVolumeSpecName: "kube-api-access-kkthl") pod "ea668d63-5bc8-4f62-8a0c-c901c191f471" (UID: "ea668d63-5bc8-4f62-8a0c-c901c191f471"). InnerVolumeSpecName "kube-api-access-kkthl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:49:02.362901 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.362847 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea668d63-5bc8-4f62-8a0c-c901c191f471-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "ea668d63-5bc8-4f62-8a0c-c901c191f471" (UID: "ea668d63-5bc8-4f62-8a0c-c901c191f471"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:49:02.461450 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.461412 2570 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ea668d63-5bc8-4f62-8a0c-c901c191f471-must-gather-output\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:49:02.461450 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.461441 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkthl\" (UniqueName: \"kubernetes.io/projected/ea668d63-5bc8-4f62-8a0c-c901c191f471-kube-api-access-kkthl\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Jul 28 16:49:02.522146 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.522120 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7grst_must-gather-2svq2_ea668d63-5bc8-4f62-8a0c-c901c191f471/copy/0.log" Jul 28 16:49:02.522457 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.522434 2570 generic.go:356] "Generic (PLEG): container finished" podID="ea668d63-5bc8-4f62-8a0c-c901c191f471" containerID="51b1ac9dc40d6400427073e50683a99e2f28576340785025d6b04e570bbee4f8" exitCode=143 Jul 28 16:49:02.522508 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.522483 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7grst/must-gather-2svq2" Jul 28 16:49:02.522508 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.522505 2570 scope.go:117] "RemoveContainer" containerID="51b1ac9dc40d6400427073e50683a99e2f28576340785025d6b04e570bbee4f8" Jul 28 16:49:02.524677 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:49:02.524641 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-2svq2\" is forbidden: User \"system:node:ip-10-0-140-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7grst\": no relationship found between node 'ip-10-0-140-117.ec2.internal' and this object" podUID="ea668d63-5bc8-4f62-8a0c-c901c191f471" pod="openshift-must-gather-7grst/must-gather-2svq2" Jul 28 16:49:02.530988 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.530971 2570 scope.go:117] "RemoveContainer" containerID="c11126c3f25d3fc921a35ae77f86b1231e080adde811c30177350858fa2948d8" Jul 28 16:49:02.532636 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:49:02.532608 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-2svq2\" is forbidden: User \"system:node:ip-10-0-140-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7grst\": no relationship found between node 'ip-10-0-140-117.ec2.internal' and this object" podUID="ea668d63-5bc8-4f62-8a0c-c901c191f471" pod="openshift-must-gather-7grst/must-gather-2svq2" Jul 28 16:49:02.541888 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.541873 2570 scope.go:117] "RemoveContainer" containerID="51b1ac9dc40d6400427073e50683a99e2f28576340785025d6b04e570bbee4f8" Jul 28 16:49:02.542121 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:49:02.542106 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51b1ac9dc40d6400427073e50683a99e2f28576340785025d6b04e570bbee4f8\": container with ID starting with 51b1ac9dc40d6400427073e50683a99e2f28576340785025d6b04e570bbee4f8 not found: ID does not exist" containerID="51b1ac9dc40d6400427073e50683a99e2f28576340785025d6b04e570bbee4f8" Jul 28 16:49:02.542165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.542129 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b1ac9dc40d6400427073e50683a99e2f28576340785025d6b04e570bbee4f8"} err="failed to get container status \"51b1ac9dc40d6400427073e50683a99e2f28576340785025d6b04e570bbee4f8\": rpc error: code = NotFound desc = could not find container \"51b1ac9dc40d6400427073e50683a99e2f28576340785025d6b04e570bbee4f8\": container with ID starting with 51b1ac9dc40d6400427073e50683a99e2f28576340785025d6b04e570bbee4f8 not found: ID does not exist" Jul 28 16:49:02.542165 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.542145 2570 scope.go:117] "RemoveContainer" containerID="c11126c3f25d3fc921a35ae77f86b1231e080adde811c30177350858fa2948d8" Jul 28 16:49:02.542347 ip-10-0-140-117 kubenswrapper[2570]: E0728 16:49:02.542331 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c11126c3f25d3fc921a35ae77f86b1231e080adde811c30177350858fa2948d8\": container with ID starting with c11126c3f25d3fc921a35ae77f86b1231e080adde811c30177350858fa2948d8 not found: ID does not exist" containerID="c11126c3f25d3fc921a35ae77f86b1231e080adde811c30177350858fa2948d8" Jul 28 16:49:02.542389 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:02.542350 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c11126c3f25d3fc921a35ae77f86b1231e080adde811c30177350858fa2948d8"} err="failed to get container status \"c11126c3f25d3fc921a35ae77f86b1231e080adde811c30177350858fa2948d8\": rpc error: code = NotFound desc = could not find container \"c11126c3f25d3fc921a35ae77f86b1231e080adde811c30177350858fa2948d8\": container with ID starting with c11126c3f25d3fc921a35ae77f86b1231e080adde811c30177350858fa2948d8 not found: ID does not exist" Jul 28 16:49:03.053094 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:03.053066 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea668d63-5bc8-4f62-8a0c-c901c191f471" path="/var/lib/kubelet/pods/ea668d63-5bc8-4f62-8a0c-c901c191f471/volumes" Jul 28 16:49:04.132880 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:04.132837 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-hpg4h_600bd436-3e95-4e94-a3c7-d4c1a6e8a16a/kube-state-metrics/0.log" Jul 28 16:49:04.170018 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:04.169983 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-hpg4h_600bd436-3e95-4e94-a3c7-d4c1a6e8a16a/kube-rbac-proxy-main/0.log" Jul 28 16:49:04.204734 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:04.204682 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-hpg4h_600bd436-3e95-4e94-a3c7-d4c1a6e8a16a/kube-rbac-proxy-self/0.log" Jul 28 16:49:04.400354 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:04.400265 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hh8dg_0538e8cd-1cdd-4daf-8a97-37b13f9e4add/node-exporter/0.log" Jul 28 16:49:04.438861 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:04.438833 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hh8dg_0538e8cd-1cdd-4daf-8a97-37b13f9e4add/kube-rbac-proxy/0.log" Jul 28 16:49:04.470563 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:04.470538 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hh8dg_0538e8cd-1cdd-4daf-8a97-37b13f9e4add/init-textfile/0.log" Jul 28 16:49:04.590892 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:04.590864 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-jg5qh_7ec2fd20-2625-4614-aa1b-75edaf251e41/kube-rbac-proxy-main/0.log" Jul 28 16:49:04.629801 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:04.629776 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-jg5qh_7ec2fd20-2625-4614-aa1b-75edaf251e41/kube-rbac-proxy-self/0.log" Jul 28 16:49:04.661082 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:04.661009 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-jg5qh_7ec2fd20-2625-4614-aa1b-75edaf251e41/openshift-state-metrics/0.log" Jul 28 16:49:04.737200 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:04.737162 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1aa1856-2588-4531-afee-4e434a96af17/prometheus/0.log" Jul 28 16:49:04.768777 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:04.768749 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1aa1856-2588-4531-afee-4e434a96af17/config-reloader/0.log" Jul 28 16:49:04.806114 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:04.806083 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1aa1856-2588-4531-afee-4e434a96af17/thanos-sidecar/0.log" Jul 28 16:49:04.837745 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:04.837719 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1aa1856-2588-4531-afee-4e434a96af17/kube-rbac-proxy-web/0.log" Jul 28 16:49:04.877284 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:04.877257 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1aa1856-2588-4531-afee-4e434a96af17/kube-rbac-proxy/0.log" Jul 28 16:49:04.906836 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:04.906812 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1aa1856-2588-4531-afee-4e434a96af17/kube-rbac-proxy-thanos/0.log" Jul 28 16:49:04.943815 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:04.943743 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1aa1856-2588-4531-afee-4e434a96af17/init-config-reloader/0.log" Jul 28 16:49:05.082327 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:05.082298 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-xpkdj_c4266acf-af05-4015-a11d-2b6686427299/prometheus-operator-admission-webhook/0.log" Jul 28 16:49:05.131976 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:05.131937 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f55877cd5-zxsc8_6b345d10-1db3-400f-9183-e773250777e3/telemeter-client/0.log" Jul 28 16:49:05.184036 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:05.184002 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f55877cd5-zxsc8_6b345d10-1db3-400f-9183-e773250777e3/reload/0.log" Jul 28 16:49:05.232943 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:05.232909 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f55877cd5-zxsc8_6b345d10-1db3-400f-9183-e773250777e3/kube-rbac-proxy/0.log" Jul 28 16:49:05.269883 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:05.269857 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6644c499d4-bssj2_e36c62b2-b2b7-4028-b404-e4be3f0b4559/thanos-query/0.log" Jul 28 16:49:05.301333 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:05.301301 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6644c499d4-bssj2_e36c62b2-b2b7-4028-b404-e4be3f0b4559/kube-rbac-proxy-web/0.log" Jul 28 16:49:05.333876 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:05.333848 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6644c499d4-bssj2_e36c62b2-b2b7-4028-b404-e4be3f0b4559/kube-rbac-proxy/0.log" Jul 28 16:49:05.375772 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:05.375743 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6644c499d4-bssj2_e36c62b2-b2b7-4028-b404-e4be3f0b4559/prom-label-proxy/0.log" Jul 28 16:49:05.409885 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:05.409860 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6644c499d4-bssj2_e36c62b2-b2b7-4028-b404-e4be3f0b4559/kube-rbac-proxy-rules/0.log" Jul 28 16:49:05.442010 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:05.441985 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6644c499d4-bssj2_e36c62b2-b2b7-4028-b404-e4be3f0b4559/kube-rbac-proxy-metrics/0.log" Jul 28 16:49:06.457386 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:06.457303 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-8v2kh_25ea5499-daf3-488a-8c11-cbd3af4c2587/networking-console-plugin/0.log" Jul 28 16:49:07.257727 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.257679 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-wxn6g_5433cfda-c43b-472c-86bf-411f8a634f63/download-server/0.log" Jul 28 16:49:07.299954 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.299923 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf"] Jul 28 16:49:07.300293 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.300280 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea668d63-5bc8-4f62-8a0c-c901c191f471" containerName="copy" Jul 28 16:49:07.300340 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.300295 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea668d63-5bc8-4f62-8a0c-c901c191f471" containerName="copy" Jul 28 16:49:07.300340 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.300309 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea668d63-5bc8-4f62-8a0c-c901c191f471" containerName="gather" Jul 28 16:49:07.300340 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.300314 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea668d63-5bc8-4f62-8a0c-c901c191f471" containerName="gather" Jul 28 16:49:07.300429 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.300372 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea668d63-5bc8-4f62-8a0c-c901c191f471" containerName="gather" Jul 28 16:49:07.300429 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.300380 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea668d63-5bc8-4f62-8a0c-c901c191f471" containerName="copy" Jul 28 16:49:07.305871 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.305848 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:07.308102 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.308080 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ndr5k\"/\"kube-root-ca.crt\"" Jul 28 16:49:07.309073 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.309047 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ndr5k\"/\"openshift-service-ca.crt\"" Jul 28 16:49:07.309073 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.309069 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ndr5k\"/\"default-dockercfg-lfbpn\"" Jul 28 16:49:07.311099 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.311081 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf"] Jul 28 16:49:07.311395 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.311378 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9357300-a160-4fe4-8ff8-3f579781874f-podres\") pod \"perf-node-gather-daemonset-q7vhf\" (UID: \"d9357300-a160-4fe4-8ff8-3f579781874f\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:07.311473 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.311404 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp5wl\" (UniqueName: \"kubernetes.io/projected/d9357300-a160-4fe4-8ff8-3f579781874f-kube-api-access-zp5wl\") pod \"perf-node-gather-daemonset-q7vhf\" (UID: \"d9357300-a160-4fe4-8ff8-3f579781874f\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:07.311473 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.311428 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9357300-a160-4fe4-8ff8-3f579781874f-lib-modules\") pod \"perf-node-gather-daemonset-q7vhf\" (UID: \"d9357300-a160-4fe4-8ff8-3f579781874f\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:07.311586 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.311529 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9357300-a160-4fe4-8ff8-3f579781874f-sys\") pod \"perf-node-gather-daemonset-q7vhf\" (UID: \"d9357300-a160-4fe4-8ff8-3f579781874f\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:07.311586 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.311557 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9357300-a160-4fe4-8ff8-3f579781874f-proc\") pod \"perf-node-gather-daemonset-q7vhf\" (UID: \"d9357300-a160-4fe4-8ff8-3f579781874f\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:07.411949 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.411913 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9357300-a160-4fe4-8ff8-3f579781874f-proc\") pod \"perf-node-gather-daemonset-q7vhf\" (UID: \"d9357300-a160-4fe4-8ff8-3f579781874f\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:07.412153 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.411989 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9357300-a160-4fe4-8ff8-3f579781874f-podres\") pod \"perf-node-gather-daemonset-q7vhf\" (UID: \"d9357300-a160-4fe4-8ff8-3f579781874f\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:07.412153 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.412008 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp5wl\" (UniqueName: \"kubernetes.io/projected/d9357300-a160-4fe4-8ff8-3f579781874f-kube-api-access-zp5wl\") pod \"perf-node-gather-daemonset-q7vhf\" (UID: \"d9357300-a160-4fe4-8ff8-3f579781874f\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:07.412153 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.412027 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9357300-a160-4fe4-8ff8-3f579781874f-lib-modules\") pod \"perf-node-gather-daemonset-q7vhf\" (UID: \"d9357300-a160-4fe4-8ff8-3f579781874f\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:07.412153 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.412034 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9357300-a160-4fe4-8ff8-3f579781874f-proc\") pod \"perf-node-gather-daemonset-q7vhf\" (UID: \"d9357300-a160-4fe4-8ff8-3f579781874f\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:07.412153 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.412053 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9357300-a160-4fe4-8ff8-3f579781874f-sys\") pod \"perf-node-gather-daemonset-q7vhf\" (UID: \"d9357300-a160-4fe4-8ff8-3f579781874f\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:07.412153 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.412144 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9357300-a160-4fe4-8ff8-3f579781874f-sys\") pod \"perf-node-gather-daemonset-q7vhf\" (UID: \"d9357300-a160-4fe4-8ff8-3f579781874f\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:07.412489 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.412173 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9357300-a160-4fe4-8ff8-3f579781874f-lib-modules\") pod \"perf-node-gather-daemonset-q7vhf\" (UID: \"d9357300-a160-4fe4-8ff8-3f579781874f\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:07.412489 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.412176 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9357300-a160-4fe4-8ff8-3f579781874f-podres\") pod \"perf-node-gather-daemonset-q7vhf\" (UID: \"d9357300-a160-4fe4-8ff8-3f579781874f\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:07.421603 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.421581 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp5wl\" (UniqueName: \"kubernetes.io/projected/d9357300-a160-4fe4-8ff8-3f579781874f-kube-api-access-zp5wl\") pod \"perf-node-gather-daemonset-q7vhf\" (UID: \"d9357300-a160-4fe4-8ff8-3f579781874f\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:07.617874 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.617838 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:07.741065 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:07.741035 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf"] Jul 28 16:49:07.744465 ip-10-0-140-117 kubenswrapper[2570]: W0728 16:49:07.744431 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd9357300_a160_4fe4_8ff8_3f579781874f.slice/crio-fc7eb0830e6d409c21fcbe8da1c9fc5a870db93ab4f926d3419ff9554a26c29f WatchSource:0}: Error finding container fc7eb0830e6d409c21fcbe8da1c9fc5a870db93ab4f926d3419ff9554a26c29f: Status 404 returned error can't find the container with id fc7eb0830e6d409c21fcbe8da1c9fc5a870db93ab4f926d3419ff9554a26c29f Jul 28 16:49:08.551789 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:08.551756 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" event={"ID":"d9357300-a160-4fe4-8ff8-3f579781874f","Type":"ContainerStarted","Data":"e6e0c24b4e31632dc72f66993d57476a260c60f4003c2e825040301a5ab86ee8"} Jul 28 16:49:08.551964 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:08.551807 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" event={"ID":"d9357300-a160-4fe4-8ff8-3f579781874f","Type":"ContainerStarted","Data":"fc7eb0830e6d409c21fcbe8da1c9fc5a870db93ab4f926d3419ff9554a26c29f"} Jul 28 16:49:08.551964 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:08.551865 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:08.555068 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:08.555035 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dk8k8_c33d7eac-0a52-4dd3-ac04-8270ea27bb01/dns/0.log" Jul 28 16:49:08.567893 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:08.567854 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" podStartSLOduration=1.567836979 podStartE2EDuration="1.567836979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:49:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:49:08.566144509 +0000 UTC m=+794.045693104" watchObservedRunningTime="2026-07-28 16:49:08.567836979 +0000 UTC m=+794.047385573" Jul 28 16:49:08.577609 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:08.577588 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dk8k8_c33d7eac-0a52-4dd3-ac04-8270ea27bb01/kube-rbac-proxy/0.log" Jul 28 16:49:08.645856 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:08.645826 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4ztpj_750f3037-9908-4415-9550-90fc8f863882/dns-node-resolver/0.log" Jul 28 16:49:09.076380 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:09.076348 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67c6854748-sf82n_411b1dbf-5e94-48d6-9f24-8845319a37f3/registry/0.log" Jul 28 16:49:09.095616 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:09.095556 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2bvtp_99b4a0dc-9c95-4215-8c0c-2e18b9442836/node-ca/0.log" Jul 28 16:49:10.113755 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:10.113722 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kc5n4_7a0189c0-e01f-4b0c-94db-a61478aac890/serve-healthcheck-canary/0.log" Jul 28 16:49:10.534704 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:10.534674 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-62qjc_9cd2b93f-c34f-460a-b55d-fdeebd7def4e/kube-rbac-proxy/0.log" Jul 28 16:49:10.555649 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:10.555620 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-62qjc_9cd2b93f-c34f-460a-b55d-fdeebd7def4e/exporter/0.log" Jul 28 16:49:10.578401 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:10.578370 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-62qjc_9cd2b93f-c34f-460a-b55d-fdeebd7def4e/extractor/0.log" Jul 28 16:49:14.566353 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:14.566327 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-q7vhf" Jul 28 16:49:15.320973 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:15.320947 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-pd2tg_f9df04a4-e9eb-455e-ba58-36045c0e5b00/migrator/0.log" Jul 28 16:49:15.339822 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:15.339792 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-pd2tg_f9df04a4-e9eb-455e-ba58-36045c0e5b00/graceful-termination/0.log" Jul 28 16:49:16.836471 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:16.836445 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-77cw2_161c4091-677f-4218-8594-cbe3d29004c7/kube-multus-additional-cni-plugins/0.log" Jul 28 16:49:16.861740 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:16.861683 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-77cw2_161c4091-677f-4218-8594-cbe3d29004c7/egress-router-binary-copy/0.log" Jul 28 16:49:16.886347 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:16.886327 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-77cw2_161c4091-677f-4218-8594-cbe3d29004c7/cni-plugins/0.log" Jul 28 16:49:16.910666 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:16.910639 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-77cw2_161c4091-677f-4218-8594-cbe3d29004c7/bond-cni-plugin/0.log" Jul 28 16:49:16.932664 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:16.932639 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-77cw2_161c4091-677f-4218-8594-cbe3d29004c7/routeoverride-cni/0.log" Jul 28 16:49:16.955469 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:16.955443 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-77cw2_161c4091-677f-4218-8594-cbe3d29004c7/whereabouts-cni-bincopy/0.log" Jul 28 16:49:16.976570 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:16.976499 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-77cw2_161c4091-677f-4218-8594-cbe3d29004c7/whereabouts-cni/0.log" Jul 28 16:49:17.230983 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:17.230904 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zqc4q_8256e603-8e9d-41ad-b9cc-784338dddcf0/kube-multus/0.log" Jul 28 16:49:17.338495 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:17.338466 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rk2lg_43046d78-bb7a-40ab-9e3e-d2d901471738/network-metrics-daemon/0.log" Jul 28 16:49:17.357097 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:17.357072 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rk2lg_43046d78-bb7a-40ab-9e3e-d2d901471738/kube-rbac-proxy/0.log" Jul 28 16:49:18.119082 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:18.119042 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5rc9g_c4739766-1cfe-4c32-b9a5-80b39d7ca485/ovn-controller/0.log" Jul 28 16:49:18.135941 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:18.135915 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5rc9g_c4739766-1cfe-4c32-b9a5-80b39d7ca485/ovn-acl-logging/0.log" Jul 28 16:49:18.157911 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:18.157831 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5rc9g_c4739766-1cfe-4c32-b9a5-80b39d7ca485/kube-rbac-proxy-node/0.log" Jul 28 16:49:18.180354 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:18.180333 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5rc9g_c4739766-1cfe-4c32-b9a5-80b39d7ca485/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 16:49:18.201198 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:18.201176 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5rc9g_c4739766-1cfe-4c32-b9a5-80b39d7ca485/northd/0.log" Jul 28 16:49:18.222553 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:18.222527 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5rc9g_c4739766-1cfe-4c32-b9a5-80b39d7ca485/nbdb/0.log" Jul 28 16:49:18.247129 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:18.247104 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5rc9g_c4739766-1cfe-4c32-b9a5-80b39d7ca485/sbdb/0.log" Jul 28 16:49:18.297252 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:18.297220 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5rc9g_c4739766-1cfe-4c32-b9a5-80b39d7ca485/ovnkube-controller/0.log" Jul 28 16:49:19.675942 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:19.675906 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-ghkxh_a34f5490-8d32-4aba-808d-5d9a2b0b65e6/network-check-target-container/0.log" Jul 28 16:49:20.646168 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:20.646136 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-cnxsw_60740267-062b-483e-a3d6-c15cac4a5d70/iptables-alerter/0.log" Jul 28 16:49:21.280891 ip-10-0-140-117 kubenswrapper[2570]: I0728 16:49:21.280861 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-bv6hj_f91f1f9b-2162-4684-93c6-ade306fa6522/tuned/0.log"