Jul 07 13:50:51.406420 ip-10-0-140-38 systemd[1]: Starting Kubernetes Kubelet... Jul 07 13:50:53.456641 ip-10-0-140-38 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 13:50:53.456641 ip-10-0-140-38 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 13:50:53.456641 ip-10-0-140-38 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 13:50:53.456641 ip-10-0-140-38 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 13:50:53.456641 ip-10-0-140-38 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 13:50:53.458978 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.458888 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 13:50:53.463577 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463558 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:50:53.463577 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463574 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:50:53.463577 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463579 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:50:53.463577 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463583 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463587 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463592 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463596 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463603 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463609 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463613 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463617 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463621 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463625 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463634 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463638 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463642 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463646 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463650 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463654 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463658 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463662 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463668 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:50:53.463854 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463673 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463676 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463682 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463685 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463689 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463693 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463697 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463701 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463705 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463709 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463713 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463717 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463721 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463725 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463729 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463735 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463739 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463743 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463747 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463752 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:50:53.464478 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463755 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463759 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463764 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463769 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463774 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463779 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463784 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463788 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463793 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463797 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463801 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463804 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463808 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463813 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463817 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463821 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463838 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463844 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463848 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:50:53.465006 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463853 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463857 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463861 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463865 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463869 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463873 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463877 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463881 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463886 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463890 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463898 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463902 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463906 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463910 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463914 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463918 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463922 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463926 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463932 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463936 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:50:53.465706 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463941 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:50:53.466201 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463945 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:50:53.466201 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463949 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:50:53.466201 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463956 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:50:53.466201 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463962 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:50:53.466201 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463967 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:50:53.466201 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463972 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:50:53.466201 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463976 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:50:53.466201 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463980 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:50:53.466201 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463984 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:50:53.466201 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463988 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:50:53.466201 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463992 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:50:53.466201 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.463997 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:50:53.466201 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.464001 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:50:53.466201 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.464005 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:50:53.466201 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.464009 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:50:53.466201 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.464013 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:50:53.466201 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.464017 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:50:53.466696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466681 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:50:53.466696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466697 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466701 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466705 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466708 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466711 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466714 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466718 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466721 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466723 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466726 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466729 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466732 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466735 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466737 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466740 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466743 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466745 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466748 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466750 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466753 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:50:53.466749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466756 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466759 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466762 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466765 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466774 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466777 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466780 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466783 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466785 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466788 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466790 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466793 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466796 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466798 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466800 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466803 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466805 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466807 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466810 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466812 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:50:53.467247 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466815 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466817 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466819 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466822 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466824 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466843 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466846 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466848 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466851 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466855 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466857 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466860 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466862 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466865 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466873 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466876 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466879 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466881 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466884 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:50:53.467749 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466886 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466890 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466895 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466898 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466901 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466905 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466907 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466910 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466913 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466917 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466921 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466924 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466927 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466929 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466932 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466935 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466938 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466941 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466943 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:50:53.468218 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466946 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466948 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466951 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466953 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466957 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466960 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466962 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466965 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466969 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466972 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466974 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466976 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466979 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466981 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466984 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466986 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466989 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466991 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466995 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.466999 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:50:53.468662 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467410 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467415 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467418 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467421 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467424 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467427 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467430 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467432 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467435 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467437 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467439 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467442 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467445 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467447 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467450 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467452 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467455 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467458 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467461 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467463 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:50:53.469153 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467466 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467469 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467471 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467474 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467476 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467479 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467481 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467483 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467486 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467488 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467491 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467494 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467498 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467501 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467504 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467506 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467509 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467511 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467514 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:50:53.469623 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467516 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467519 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467521 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467523 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467527 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467529 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467532 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467534 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467537 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467539 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467543 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467545 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467548 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467550 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467553 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467555 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467558 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467560 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467562 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467565 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:50:53.470087 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467567 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467570 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467572 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467574 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467577 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467579 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467582 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467585 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467587 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467590 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467593 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467595 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467598 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467600 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467602 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467605 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467608 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467610 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467613 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467615 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:50:53.470558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467617 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467620 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467622 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467625 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467628 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467630 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467632 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467635 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467637 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467639 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467641 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467644 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467646 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467648 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467651 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467653 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467657 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467660 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467664 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:50:53.471046 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.467667 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467740 2560 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467747 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467753 2560 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467758 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467762 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467765 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467769 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467774 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467777 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467780 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467783 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467787 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467790 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467793 2560 flags.go:64] FLAG: --cgroup-root="" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467796 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467799 2560 flags.go:64] FLAG: --client-ca-file="" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467802 2560 flags.go:64] FLAG: --cloud-provider="external" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467805 2560 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467810 2560 flags.go:64] FLAG: --cluster-domain="" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467812 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467815 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467818 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467821 2560 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 13:50:53.471525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467825 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467841 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467844 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467847 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467850 2560 flags.go:64] FLAG: --contention-profiling="false" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467853 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467856 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467859 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467864 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467868 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467871 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467874 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467876 2560 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467879 2560 flags.go:64] FLAG: --enable-server="true" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467882 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467887 2560 flags.go:64] FLAG: --event-burst="100" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467890 2560 flags.go:64] FLAG: --event-qps="50" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467893 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467895 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467898 2560 flags.go:64] FLAG: --eviction-hard="" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467902 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467905 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467908 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467913 2560 flags.go:64] FLAG: --eviction-soft="" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467916 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 13:50:53.472110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467918 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467923 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467926 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467929 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467932 2560 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467934 2560 flags.go:64] FLAG: --feature-gates="" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467938 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467941 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467944 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467947 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467950 2560 flags.go:64] FLAG: --healthz-port="10248" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467953 2560 flags.go:64] FLAG: --help="false" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467956 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-140-38.ec2.internal" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467959 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467962 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467966 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467969 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467973 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467975 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467978 2560 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467981 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467984 2560 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467987 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467990 2560 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 13:50:53.472712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467993 2560 flags.go:64] FLAG: --kube-reserved="" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467996 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.467999 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468002 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468005 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468008 2560 flags.go:64] FLAG: --lock-file="" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468011 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468014 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468017 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468022 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468025 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468028 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468031 2560 flags.go:64] FLAG: --logging-format="text" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468034 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468037 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468039 2560 flags.go:64] FLAG: --manifest-url="" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468042 2560 flags.go:64] FLAG: --manifest-url-header="" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468046 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468049 2560 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468053 2560 flags.go:64] FLAG: --max-pods="110" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468056 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468059 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468062 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468066 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468069 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 13:50:53.473353 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468071 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468074 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468081 2560 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468084 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468087 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468090 2560 flags.go:64] FLAG: --pod-cidr="" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468093 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468098 2560 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468101 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468104 2560 flags.go:64] FLAG: --pods-per-core="0" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468107 2560 flags.go:64] FLAG: --port="10250" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468110 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468112 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b38d0c6a62c877cc" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468115 2560 flags.go:64] FLAG: --qos-reserved="" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468120 2560 flags.go:64] FLAG: --read-only-port="10255" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468123 2560 flags.go:64] FLAG: --register-node="true" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468126 2560 flags.go:64] FLAG: --register-with-taints="" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468129 2560 flags.go:64] FLAG: --registry-burst="10" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468135 2560 flags.go:64] FLAG: --registry-qps="5" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468138 2560 flags.go:64] FLAG: --reserved-cpus="" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468141 2560 flags.go:64] FLAG: --reserved-memory="" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468145 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468147 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468150 2560 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468153 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 13:50:53.473968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468156 2560 flags.go:64] FLAG: --runonce="false" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468158 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468161 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468164 2560 flags.go:64] FLAG: --seccomp-default="false" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468167 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468171 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468174 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468177 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468180 2560 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468182 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468185 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468188 2560 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468191 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468194 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468196 2560 flags.go:64] FLAG: --system-cgroups="" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468199 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468204 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468207 2560 flags.go:64] FLAG: --tls-cert-file="" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468210 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468214 2560 flags.go:64] FLAG: --tls-min-version="" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468216 2560 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468222 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468225 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468228 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468231 2560 flags.go:64] FLAG: --v="2" Jul 07 13:50:53.474588 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468235 2560 flags.go:64] FLAG: --version="false" Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468240 2560 flags.go:64] FLAG: --vmodule="" Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468244 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.468247 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468361 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468364 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468367 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468370 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468373 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468375 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468378 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468380 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468384 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468387 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468389 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468392 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468394 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468396 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468399 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468401 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468404 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:50:53.475305 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468406 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468409 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468411 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468414 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468416 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468418 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468421 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468426 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468428 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468430 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468434 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468438 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468441 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468444 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468447 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468449 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468451 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468454 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468456 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468459 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:50:53.475816 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468461 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468464 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468466 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468470 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468473 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468475 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468479 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468482 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468485 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468488 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468490 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468493 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468496 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468498 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468501 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468503 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468506 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468509 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468511 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:50:53.476338 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468516 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468519 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468521 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468525 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468527 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468530 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468534 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468537 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468540 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468543 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468546 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468548 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468551 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468554 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468556 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468559 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468562 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468565 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468568 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:50:53.476778 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468570 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468572 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468575 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468577 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468579 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468582 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468584 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468587 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468589 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468591 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468594 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468597 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468599 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468603 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468605 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468608 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468610 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468613 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468615 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468618 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:50:53.477243 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468620 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:50:53.477710 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468623 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:50:53.477710 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468625 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:50:53.477710 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.468628 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:50:53.477710 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.469200 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 13:50:53.477710 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.475870 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 13:50:53.477710 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.475888 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 13:50:53.477710 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.475908 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 13:50:53.477710 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.475914 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 13:50:53.477710 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.475971 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:50:53.477710 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.475976 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:50:53.477710 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.475980 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:50:53.477710 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.475984 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:50:53.477710 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.475988 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:50:53.477710 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.475992 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.475995 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.475998 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476000 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476003 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476006 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476009 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476012 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476014 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476017 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476019 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476022 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476024 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476027 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476030 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476032 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476035 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476037 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476040 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476042 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:50:53.478082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476045 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476047 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476050 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476052 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476056 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476059 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476061 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476064 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476066 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476069 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476071 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476074 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476076 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476079 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476082 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476084 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476087 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476089 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476092 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476095 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:50:53.478547 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476097 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476100 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476102 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476105 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476107 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476109 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476112 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476114 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476117 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476119 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476121 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476124 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476127 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476129 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476132 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476135 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476137 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476140 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476143 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:50:53.479096 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476145 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476149 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476153 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476156 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476158 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476160 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476164 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476167 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476170 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476173 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476176 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476178 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476181 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476183 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476186 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476189 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476191 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476194 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476196 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:50:53.479537 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476199 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:50:53.479990 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476202 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:50:53.479990 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476204 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:50:53.479990 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476206 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:50:53.479990 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476209 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:50:53.479990 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476211 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:50:53.479990 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476214 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:50:53.479990 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476216 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:50:53.479990 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476219 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:50:53.479990 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476222 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:50:53.479990 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476225 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:50:53.479990 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476227 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:50:53.479990 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476230 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:50:53.479990 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476233 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:50:53.479990 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476235 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:50:53.479990 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476238 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:50:53.480341 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.476243 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 13:50:53.480341 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476355 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:50:53.480341 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476359 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:50:53.480341 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476362 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:50:53.480341 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476365 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:50:53.480341 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476368 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:50:53.480341 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476371 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:50:53.480341 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476373 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:50:53.480341 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476376 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:50:53.480341 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476380 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:50:53.480341 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476383 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:50:53.480341 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476385 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:50:53.480341 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476388 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:50:53.480341 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476391 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:50:53.480341 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476393 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476396 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476398 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476401 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476405 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476408 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476412 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476415 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476418 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476420 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476423 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476426 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476428 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476431 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476433 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476436 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476439 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476441 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476443 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:50:53.480696 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476446 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476448 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476451 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476453 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476455 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476458 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476460 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476463 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476466 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476468 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476470 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476472 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476475 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476477 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476480 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476482 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476485 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476487 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:50:53.481159 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476490 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476493 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476496 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476499 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476502 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476504 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476507 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476509 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476512 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476514 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476517 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476520 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476523 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476525 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476528 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476530 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476532 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476535 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476537 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476540 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:50:53.481597 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476542 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476545 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476547 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476549 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476552 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476554 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476557 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476559 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476561 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476564 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476566 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476569 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476571 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476574 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476576 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476578 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476581 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476583 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476586 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476588 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:50:53.482086 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476591 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:50:53.482558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476593 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:50:53.482558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476596 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:50:53.482558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476599 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:50:53.482558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476602 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:50:53.482558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476604 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:50:53.482558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476607 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:50:53.482558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476609 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:50:53.482558 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:53.476611 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:50:53.482558 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.476616 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 13:50:53.482558 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.476733 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 13:50:53.482558 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.478881 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 13:50:53.482558 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.480310 2560 server.go:1019] "Starting client certificate rotation" Jul 07 13:50:53.482558 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.480408 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 13:50:53.482558 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.480463 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 13:50:53.483311 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.483298 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 13:50:53.484569 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.484553 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 13:50:53.489784 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.489767 2560 log.go:25] "Validated CRI v1 runtime API" Jul 07 13:50:53.491748 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.491734 2560 log.go:25] "Validated CRI v1 image API" Jul 07 13:50:53.492431 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.492418 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 13:50:53.495493 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.495474 2560 fs.go:135] Filesystem UUIDs: map[291de118-42de-4775-b3a4-dc7690ef1e15:/dev/nvme0n1p3 4c189a8f-785d-40db-b749-11c9ac980147:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 07 13:50:53.495564 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.495492 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 13:50:53.501283 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.501161 2560 manager.go:216] Machine: {Timestamp:2026-07-07 13:50:53.49973709 +0000 UTC m=+0.364941545 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199336 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f50afb048e81b31028059389a0626 SystemUUID:ec2f50af-b048-e81b-3102-8059389a0626 BootID:f0f721f7-f940-45df-aabe-a9d79473ffb3 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:75:ac:1e:38:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:75:ac:1e:38:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:c7:57:b5:df:ee Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 13:50:53.501283 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.501265 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 13:50:53.501434 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.501380 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 13:50:53.504390 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.504364 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 13:50:53.504523 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.504393 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-38.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 13:50:53.505719 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.505709 2560 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 13:50:53.505752 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.505722 2560 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 13:50:53.505752 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.505729 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 13:50:53.506364 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.506354 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 13:50:53.507210 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.507198 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 13:50:53.510320 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.510308 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 07 13:50:53.510429 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.510420 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 13:50:53.511187 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.511178 2560 kubelet.go:486] "Attempting to sync node with API server" Jul 07 13:50:53.511253 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.511190 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 13:50:53.511253 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.511205 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 13:50:53.511253 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.511214 2560 kubelet.go:398] "Adding apiserver pod source" Jul 07 13:50:53.511253 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.511223 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 13:50:53.511598 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.511586 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 13:50:53.511650 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.511607 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 13:50:53.513294 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.513277 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 13:50:53.516424 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.516409 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 13:50:53.517820 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.517807 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 13:50:53.517899 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.517852 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 13:50:53.518965 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.518950 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 13:50:53.519001 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.518976 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 13:50:53.519001 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.518986 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 13:50:53.519001 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.518994 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 13:50:53.519088 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.519003 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 13:50:53.519088 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.519010 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 13:50:53.519088 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.519021 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 13:50:53.519088 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.519027 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 13:50:53.519088 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.519036 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 13:50:53.519088 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.519042 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 13:50:53.519088 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.519050 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 13:50:53.519088 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.519055 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 13:50:53.520911 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.520899 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 13:50:53.520984 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.520913 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 13:50:53.522413 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.522391 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 13:50:53.522482 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.522375 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 13:50:53.524140 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.524127 2560 server.go:1268] "Started kubelet" Jul 07 13:50:53.524251 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.524226 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 13:50:53.524364 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.524267 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 13:50:53.528269 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.528240 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 13:50:53.528994 ip-10-0-140-38 systemd[1]: Started Kubernetes Kubelet. Jul 07 13:50:53.529528 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.529501 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 13:50:53.532099 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.532085 2560 server.go:310] "Adding debug handlers to kubelet server" Jul 07 13:50:53.534325 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.534305 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 13:50:53.536281 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.536268 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 13:50:53.536281 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.536273 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 13:50:53.536395 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.536380 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Jul 07 13:50:53.536951 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.536934 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-38.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 13:50:53.537083 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.537062 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 13:50:53.537083 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.537082 2560 factory.go:55] Registering systemd factory Jul 07 13:50:53.537235 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.537091 2560 factory.go:223] Registration of the systemd container factory successfully Jul 07 13:50:53.537235 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.537098 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 13:50:53.537235 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.537117 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 13:50:53.537235 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.537136 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 13:50:53.537235 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.537203 2560 reconstruct.go:97] "Volume reconstruction finished" Jul 07 13:50:53.537235 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.537211 2560 reconciler.go:29] "Reconciler: start to sync state" Jul 07 13:50:53.537494 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.537438 2560 factory.go:153] Registering CRI-O factory Jul 07 13:50:53.537494 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.537450 2560 factory.go:223] Registration of the crio container factory successfully Jul 07 13:50:53.537494 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.537471 2560 factory.go:103] Registering Raw factory Jul 07 13:50:53.537494 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.537485 2560 manager.go:1196] Started watching for new ooms in manager Jul 07 13:50:53.538042 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.536902 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-38.ec2.internal.18c0062f80474676 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-38.ec2.internal,UID:ip-10-0-140-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-38.ec2.internal,},FirstTimestamp:2026-07-07 13:50:53.524100726 +0000 UTC m=+0.389305182,LastTimestamp:2026-07-07 13:50:53.524100726 +0000 UTC m=+0.389305182,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-38.ec2.internal,}" Jul 07 13:50:53.538146 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.538095 2560 manager.go:349] Starting recovery of all containers Jul 07 13:50:53.542051 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.542005 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 13:50:53.542176 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.542153 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 13:50:53.543479 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.543457 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-klhpv" Jul 07 13:50:53.543732 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.543697 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 13:50:53.548184 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.548165 2560 manager.go:354] Recovery completed Jul 07 13:50:53.551781 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.551506 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-klhpv" Jul 07 13:50:53.554208 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.554194 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:50:53.555918 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.555902 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:50:53.555982 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.555930 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:50:53.555982 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.555939 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:50:53.556413 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.556396 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 13:50:53.556413 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.556412 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 13:50:53.556516 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.556429 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 07 13:50:53.556516 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.556405 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:50:53.557196 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.557180 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:50:53.557295 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.557207 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:50:53.557295 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.557220 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:50:53.557612 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.557589 2560 policy_none.go:49] "None policy: Start" Jul 07 13:50:53.557651 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.557619 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 13:50:53.557651 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.557633 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 13:50:53.558268 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.558185 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-38.ec2.internal.18c0062f822cc2ea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-38.ec2.internal,UID:ip-10-0-140-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-38.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-38.ec2.internal,},FirstTimestamp:2026-07-07 13:50:53.555917546 +0000 UTC m=+0.421122000,LastTimestamp:2026-07-07 13:50:53.555917546 +0000 UTC m=+0.421122000,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-38.ec2.internal,}" Jul 07 13:50:53.558902 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.558887 2560 policy_none.go:47] "Start" Jul 07 13:50:53.602385 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.602369 2560 manager.go:337] "Starting Device Plugin manager" Jul 07 13:50:53.602461 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.602408 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 13:50:53.602461 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.602417 2560 server.go:87] "Starting device plugin registration server" Jul 07 13:50:53.602715 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.602703 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 13:50:53.602760 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.602727 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 13:50:53.602878 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.602863 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 13:50:53.602945 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.602933 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 13:50:53.602992 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.602947 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 13:50:53.603460 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.603435 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 13:50:53.603543 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.603493 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-38.ec2.internal\" not found" Jul 07 13:50:53.703349 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.703309 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:50:53.706005 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.705988 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:50:53.706096 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.706018 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:50:53.706096 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.706028 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:50:53.706096 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.706059 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-38.ec2.internal" Jul 07 13:50:53.712723 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.712685 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-38.ec2.internal" Jul 07 13:50:53.712723 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.712707 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-38.ec2.internal\": node \"ip-10-0-140-38.ec2.internal\" not found" Jul 07 13:50:53.726839 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.726811 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 13:50:53.726927 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.726858 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 13:50:53.726927 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.726876 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 13:50:53.726927 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.726905 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 13:50:53.727333 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.727302 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Jul 07 13:50:53.729117 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.729102 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:50:53.827242 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.827194 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal"] Jul 07 13:50:53.827396 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.827291 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:50:53.827437 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.827393 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Jul 07 13:50:53.828254 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.828232 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:50:53.828382 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.828264 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:50:53.828382 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.828276 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:50:53.829635 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.829620 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:50:53.829769 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.829741 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" Jul 07 13:50:53.829859 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.829786 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:50:53.830352 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.830339 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:50:53.830416 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.830367 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:50:53.830416 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.830387 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:50:53.830508 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.830339 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:50:53.830508 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.830437 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:50:53.830508 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.830447 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:50:53.832361 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.832344 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Jul 07 13:50:53.832422 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.832381 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:50:53.844399 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.844381 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:50:53.844480 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.844411 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:50:53.844480 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.844421 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:50:53.863450 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.863422 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-38.ec2.internal\" not found" node="ip-10-0-140-38.ec2.internal" Jul 07 13:50:53.867748 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.867731 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-38.ec2.internal\" not found" node="ip-10-0-140-38.ec2.internal" Jul 07 13:50:53.927469 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:53.927441 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Jul 07 13:50:53.945317 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.945293 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc314882863d165c307bf7eda7756faa-config\") pod \"kube-apiserver-proxy-ip-10-0-140-38.ec2.internal\" (UID: \"dc314882863d165c307bf7eda7756faa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" Jul 07 13:50:53.945404 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.945325 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/83d0de89030d1dc32eced03342c2d0df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal\" (UID: \"83d0de89030d1dc32eced03342c2d0df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Jul 07 13:50:53.945404 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:53.945344 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83d0de89030d1dc32eced03342c2d0df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal\" (UID: \"83d0de89030d1dc32eced03342c2d0df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Jul 07 13:50:54.028473 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:54.028414 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Jul 07 13:50:54.045873 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.045843 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc314882863d165c307bf7eda7756faa-config\") pod \"kube-apiserver-proxy-ip-10-0-140-38.ec2.internal\" (UID: \"dc314882863d165c307bf7eda7756faa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" Jul 07 13:50:54.045873 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.045865 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc314882863d165c307bf7eda7756faa-config\") pod \"kube-apiserver-proxy-ip-10-0-140-38.ec2.internal\" (UID: \"dc314882863d165c307bf7eda7756faa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" Jul 07 13:50:54.045992 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.045910 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/83d0de89030d1dc32eced03342c2d0df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal\" (UID: \"83d0de89030d1dc32eced03342c2d0df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Jul 07 13:50:54.045992 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.045929 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83d0de89030d1dc32eced03342c2d0df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal\" (UID: \"83d0de89030d1dc32eced03342c2d0df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Jul 07 13:50:54.045992 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.045969 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83d0de89030d1dc32eced03342c2d0df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal\" (UID: \"83d0de89030d1dc32eced03342c2d0df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Jul 07 13:50:54.046076 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.045988 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/83d0de89030d1dc32eced03342c2d0df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal\" (UID: \"83d0de89030d1dc32eced03342c2d0df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Jul 07 13:50:54.129007 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:54.128977 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Jul 07 13:50:54.166518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.166487 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" Jul 07 13:50:54.170952 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.170475 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Jul 07 13:50:54.229995 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:54.229958 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Jul 07 13:50:54.330635 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:54.330546 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Jul 07 13:50:54.431143 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:54.431107 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Jul 07 13:50:54.479698 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.479667 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 13:50:54.480247 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.479897 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 13:50:54.532127 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:54.532090 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Jul 07 13:50:54.555750 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.555715 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 13:45:53 +0000 UTC" deadline="2028-01-21 16:16:58.978953259 +0000 UTC" Jul 07 13:50:54.555750 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.555742 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13514h26m4.423214039s" Jul 07 13:50:54.633188 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:54.633163 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Jul 07 13:50:54.717818 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.717783 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:50:54.726572 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:54.726548 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d0de89030d1dc32eced03342c2d0df.slice/crio-2976372efffcc41ca6e3255e7eb834a98cb2d649f94e4fc08def34d2f0110836 WatchSource:0}: Error finding container 2976372efffcc41ca6e3255e7eb834a98cb2d649f94e4fc08def34d2f0110836: Status 404 returned error can't find the container with id 2976372efffcc41ca6e3255e7eb834a98cb2d649f94e4fc08def34d2f0110836 Jul 07 13:50:54.727157 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:54.727141 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc314882863d165c307bf7eda7756faa.slice/crio-948b1db930a64a9c84d5ad0ce0be92482dcd2ce25a8140d82262b71d4d7174f5 WatchSource:0}: Error finding container 948b1db930a64a9c84d5ad0ce0be92482dcd2ce25a8140d82262b71d4d7174f5: Status 404 returned error can't find the container with id 948b1db930a64a9c84d5ad0ce0be92482dcd2ce25a8140d82262b71d4d7174f5 Jul 07 13:50:54.731016 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.730999 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 13:50:54.733298 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:54.733282 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-38.ec2.internal\" not found" Jul 07 13:50:54.814564 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.814534 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:50:54.837244 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.837215 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" Jul 07 13:50:54.847974 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.847949 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 13:50:54.849055 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.849041 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" Jul 07 13:50:54.859490 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:54.859472 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 13:50:55.120226 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.120138 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:50:55.512125 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.512039 2560 apiserver.go:52] "Watching apiserver" Jul 07 13:50:55.523280 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.523253 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 13:50:55.525261 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.525227 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-rdm4s","openshift-network-diagnostics/network-check-target-2vwjz","openshift-network-operator/iptables-alerter-594pr","openshift-ovn-kubernetes/ovnkube-node-8d597","kube-system/konnectivity-agent-ppkhl","kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal","openshift-cluster-node-tuning-operator/tuned-c7spc","openshift-dns/node-resolver-zbsrw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal","openshift-multus/multus-6jlvw","openshift-multus/multus-additional-cni-plugins-xqzcq","openshift-multus/network-metrics-daemon-jvz97","kube-system/global-pull-secret-syncer-rwmks","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx"] Jul 07 13:50:55.526879 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.526859 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.528497 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.528472 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:50:55.528599 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:55.528578 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:50:55.529858 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.529838 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-594pr" Jul 07 13:50:55.531521 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.531500 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:50:55.531521 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.531517 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 13:50:55.531665 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.531550 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bphfv\"" Jul 07 13:50:55.532314 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.532297 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.534119 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.534094 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ppkhl" Jul 07 13:50:55.536156 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.535855 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.537766 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.537334 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 13:50:55.537766 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.537427 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zbsrw" Jul 07 13:50:55.538720 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.538701 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rdm4s" Jul 07 13:50:55.540499 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.540271 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:50:55.540499 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:55.540321 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:50:55.540499 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.540364 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:50:55.540694 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.540565 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 13:50:55.541692 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.541676 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 13:50:55.541821 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.541806 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 13:50:55.541821 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.541818 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 13:50:55.541956 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.541870 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 13:50:55.542013 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.541968 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 13:50:55.542013 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.541996 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 13:50:55.542101 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.542070 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 13:50:55.542181 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.542144 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 13:50:55.542236 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.542212 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-crdhc\"" Jul 07 13:50:55.542472 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.542454 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sf9mp\"" Jul 07 13:50:55.542547 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.542529 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.543036 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.542869 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-99lx9\"" Jul 07 13:50:55.543132 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.543116 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 13:50:55.543721 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.543570 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 13:50:55.543721 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.543600 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 13:50:55.544152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.544123 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w9h6n\"" Jul 07 13:50:55.544535 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.544516 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2tgch\"" Jul 07 13:50:55.544782 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.544766 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 13:50:55.545042 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.545017 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 13:50:55.545238 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.545215 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 13:50:55.546202 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.545668 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 13:50:55.547342 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.547326 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.549572 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.549491 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:50:55.549572 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:55.549557 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:50:55.551140 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.551120 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 13:50:55.551329 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.551313 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 13:50:55.551479 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.551461 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-plxbm\"" Jul 07 13:50:55.551544 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.551489 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 13:50:55.552043 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.551670 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 13:50:55.552043 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.551670 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 13:50:55.552043 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.551720 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 13:50:55.552043 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.551973 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lnswx\"" Jul 07 13:50:55.555915 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.555897 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-sysconfig\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.555993 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.555921 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-kubernetes\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.555993 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.555937 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8f2aa2b-7985-4363-84f5-bf0392006b46-tmp\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.555993 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.555958 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b575ab4d-03cc-40e2-955b-c82bce6b2d63-ovnkube-script-lib\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.555993 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.555986 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d77967e-57cd-4d6c-b943-c9bb72bbdf0f-agent-certs\") pod \"konnectivity-agent-ppkhl\" (UID: \"1d77967e-57cd-4d6c-b943-c9bb72bbdf0f\") " pod="kube-system/konnectivity-agent-ppkhl" Jul 07 13:50:55.556188 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556030 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b3f5fe49-2e39-4720-8e53-ba898c743f46-serviceca\") pod \"node-ca-rdm4s\" (UID: \"b3f5fe49-2e39-4720-8e53-ba898c743f46\") " pod="openshift-image-registry/node-ca-rdm4s" Jul 07 13:50:55.556188 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556060 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-lib-modules\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.556188 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556085 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-run-netns\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.556188 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556114 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-systemd\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.556188 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556143 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-sys-fs\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.556188 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556165 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrqbt\" (UniqueName: \"kubernetes.io/projected/00c54727-aa24-4646-9230-686cf45435be-kube-api-access-wrqbt\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.556457 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556202 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67f25601-a3a1-41ef-80da-a2a319e9e59d-tmp-dir\") pod \"node-resolver-zbsrw\" (UID: \"67f25601-a3a1-41ef-80da-a2a319e9e59d\") " pod="openshift-dns/node-resolver-zbsrw" Jul 07 13:50:55.556457 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556222 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-etc-openvswitch\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.556457 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556251 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-socket-dir\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.556457 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556267 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k476l\" (UniqueName: \"kubernetes.io/projected/b3f5fe49-2e39-4720-8e53-ba898c743f46-kube-api-access-k476l\") pod \"node-ca-rdm4s\" (UID: \"b3f5fe49-2e39-4720-8e53-ba898c743f46\") " pod="openshift-image-registry/node-ca-rdm4s" Jul 07 13:50:55.556457 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556280 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-sys\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.556457 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556314 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-systemd-units\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.556457 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556331 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-run-systemd\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.556457 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556348 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-run-ovn\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.556457 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556367 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3c340622-81e7-4b51-806b-0aea3eb6394a-kubelet-config\") pod \"global-pull-secret-syncer-rwmks\" (UID: \"3c340622-81e7-4b51-806b-0aea3eb6394a\") " pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:50:55.556457 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556388 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3c340622-81e7-4b51-806b-0aea3eb6394a-dbus\") pod \"global-pull-secret-syncer-rwmks\" (UID: \"3c340622-81e7-4b51-806b-0aea3eb6394a\") " pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:50:55.556457 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556412 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.556457 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556432 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3f5fe49-2e39-4720-8e53-ba898c743f46-host\") pod \"node-ca-rdm4s\" (UID: \"b3f5fe49-2e39-4720-8e53-ba898c743f46\") " pod="openshift-image-registry/node-ca-rdm4s" Jul 07 13:50:55.557008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556466 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a138cbd-bb6b-46be-9bcf-4d1030bfad2f-host-slash\") pod \"iptables-alerter-594pr\" (UID: \"7a138cbd-bb6b-46be-9bcf-4d1030bfad2f\") " pod="openshift-network-operator/iptables-alerter-594pr" Jul 07 13:50:55.557008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556497 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-kubelet\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.557008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556520 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-cni-netd\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.557008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556543 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7a138cbd-bb6b-46be-9bcf-4d1030bfad2f-iptables-alerter-script\") pod \"iptables-alerter-594pr\" (UID: \"7a138cbd-bb6b-46be-9bcf-4d1030bfad2f\") " pod="openshift-network-operator/iptables-alerter-594pr" Jul 07 13:50:55.557008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556585 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-host\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.557008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556617 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b575ab4d-03cc-40e2-955b-c82bce6b2d63-ovn-node-metrics-cert\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.557008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556640 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nln8c\" (UniqueName: \"kubernetes.io/projected/b575ab4d-03cc-40e2-955b-c82bce6b2d63-kube-api-access-nln8c\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.557008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556665 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-registration-dir\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.557008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556687 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-device-dir\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.557008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556711 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-modprobe-d\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.557008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556734 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-run\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.557008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556774 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b575ab4d-03cc-40e2-955b-c82bce6b2d63-ovnkube-config\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.557008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556861 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d77967e-57cd-4d6c-b943-c9bb72bbdf0f-konnectivity-ca\") pod \"konnectivity-agent-ppkhl\" (UID: \"1d77967e-57cd-4d6c-b943-c9bb72bbdf0f\") " pod="kube-system/konnectivity-agent-ppkhl" Jul 07 13:50:55.557008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556900 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgfcs\" (UniqueName: \"kubernetes.io/projected/7a138cbd-bb6b-46be-9bcf-4d1030bfad2f-kube-api-access-kgfcs\") pod \"iptables-alerter-594pr\" (UID: \"7a138cbd-bb6b-46be-9bcf-4d1030bfad2f\") " pod="openshift-network-operator/iptables-alerter-594pr" Jul 07 13:50:55.557008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556934 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-sysctl-conf\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.557008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556956 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-var-lib-kubelet\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.557626 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.556978 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-run-openvswitch\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.557626 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.557000 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-cni-bin\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.557626 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.557023 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-var-lib-openvswitch\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.557626 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.557047 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-log-socket\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.557626 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.557071 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.557626 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.557096 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-tuned\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.557626 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.557133 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-slash\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.557626 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.557166 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-run-ovn-kubernetes\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.557626 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.557190 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ztcl\" (UniqueName: \"kubernetes.io/projected/67f25601-a3a1-41ef-80da-a2a319e9e59d-kube-api-access-8ztcl\") pod \"node-resolver-zbsrw\" (UID: \"67f25601-a3a1-41ef-80da-a2a319e9e59d\") " pod="openshift-dns/node-resolver-zbsrw" Jul 07 13:50:55.557626 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.557213 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret\") pod \"global-pull-secret-syncer-rwmks\" (UID: \"3c340622-81e7-4b51-806b-0aea3eb6394a\") " pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:50:55.557626 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.557239 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-sysctl-d\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.557626 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.557259 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkbrk\" (UniqueName: \"kubernetes.io/projected/b8f2aa2b-7985-4363-84f5-bf0392006b46-kube-api-access-dkbrk\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.557626 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.557288 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-etc-selinux\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.557626 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.557310 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/67f25601-a3a1-41ef-80da-a2a319e9e59d-hosts-file\") pod \"node-resolver-zbsrw\" (UID: \"67f25601-a3a1-41ef-80da-a2a319e9e59d\") " pod="openshift-dns/node-resolver-zbsrw" Jul 07 13:50:55.557626 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.557330 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-node-log\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.557626 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.557374 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b575ab4d-03cc-40e2-955b-c82bce6b2d63-env-overrides\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.562237 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.562223 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 13:50:55.563150 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.562971 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 13:50:55.563150 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.563030 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4g82l\"" Jul 07 13:50:55.569848 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.569755 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 13:50:55.586175 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.586150 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-22kzw" Jul 07 13:50:55.592313 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.592292 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-22kzw" Jul 07 13:50:55.639044 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.639015 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 13:50:55.658289 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658261 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-sys-fs\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.658438 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658295 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrqbt\" (UniqueName: \"kubernetes.io/projected/00c54727-aa24-4646-9230-686cf45435be-kube-api-access-wrqbt\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.658438 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658318 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-run-netns\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.658438 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658361 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-hostroot\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.658438 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658382 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-sys-fs\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.658438 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658382 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-multus-conf-dir\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.658790 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658443 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe34b77f-15e4-43b5-a924-8fa943ca811e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.658790 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658499 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67f25601-a3a1-41ef-80da-a2a319e9e59d-tmp-dir\") pod \"node-resolver-zbsrw\" (UID: \"67f25601-a3a1-41ef-80da-a2a319e9e59d\") " pod="openshift-dns/node-resolver-zbsrw" Jul 07 13:50:55.658790 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658516 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-etc-openvswitch\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.658790 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-socket-dir\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.658790 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658565 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k476l\" (UniqueName: \"kubernetes.io/projected/b3f5fe49-2e39-4720-8e53-ba898c743f46-kube-api-access-k476l\") pod \"node-ca-rdm4s\" (UID: \"b3f5fe49-2e39-4720-8e53-ba898c743f46\") " pod="openshift-image-registry/node-ca-rdm4s" Jul 07 13:50:55.658790 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658594 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-etc-openvswitch\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.658790 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658602 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-multus-socket-dir-parent\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.658790 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658656 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-run-k8s-cni-cncf-io\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.658790 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658693 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-var-lib-kubelet\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.658790 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658705 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-socket-dir\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.658790 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658744 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-etc-kubernetes\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.658790 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658772 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-sys\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658875 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-systemd-units\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658922 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-sys\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658940 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-run-systemd\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658962 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-systemd-units\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.658987 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-run-ovn\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659005 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-run-systemd\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659008 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3c340622-81e7-4b51-806b-0aea3eb6394a-kubelet-config\") pod \"global-pull-secret-syncer-rwmks\" (UID: \"3c340622-81e7-4b51-806b-0aea3eb6394a\") " pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659039 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3c340622-81e7-4b51-806b-0aea3eb6394a-dbus\") pod \"global-pull-secret-syncer-rwmks\" (UID: \"3c340622-81e7-4b51-806b-0aea3eb6394a\") " pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659049 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3c340622-81e7-4b51-806b-0aea3eb6394a-kubelet-config\") pod \"global-pull-secret-syncer-rwmks\" (UID: \"3c340622-81e7-4b51-806b-0aea3eb6394a\") " pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659049 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-run-ovn\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659061 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659094 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3f5fe49-2e39-4720-8e53-ba898c743f46-host\") pod \"node-ca-rdm4s\" (UID: \"b3f5fe49-2e39-4720-8e53-ba898c743f46\") " pod="openshift-image-registry/node-ca-rdm4s" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659100 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659137 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-system-cni-dir\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659156 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a138cbd-bb6b-46be-9bcf-4d1030bfad2f-host-slash\") pod \"iptables-alerter-594pr\" (UID: \"7a138cbd-bb6b-46be-9bcf-4d1030bfad2f\") " pod="openshift-network-operator/iptables-alerter-594pr" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659178 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3c340622-81e7-4b51-806b-0aea3eb6394a-dbus\") pod \"global-pull-secret-syncer-rwmks\" (UID: \"3c340622-81e7-4b51-806b-0aea3eb6394a\") " pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659186 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-kubelet\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.659419 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659193 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3f5fe49-2e39-4720-8e53-ba898c743f46-host\") pod \"node-ca-rdm4s\" (UID: \"b3f5fe49-2e39-4720-8e53-ba898c743f46\") " pod="openshift-image-registry/node-ca-rdm4s" Jul 07 13:50:55.660215 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659224 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a138cbd-bb6b-46be-9bcf-4d1030bfad2f-host-slash\") pod \"iptables-alerter-594pr\" (UID: \"7a138cbd-bb6b-46be-9bcf-4d1030bfad2f\") " pod="openshift-network-operator/iptables-alerter-594pr" Jul 07 13:50:55.660215 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659224 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-kubelet\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.660215 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659253 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-cni-netd\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.660215 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659229 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-cni-netd\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.660215 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659280 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-multus-cni-dir\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.660215 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659300 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2319c840-63a7-450c-82be-66f05546af24-cni-binary-copy\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.660215 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659324 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe34b77f-15e4-43b5-a924-8fa943ca811e-system-cni-dir\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.660215 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659364 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7a138cbd-bb6b-46be-9bcf-4d1030bfad2f-iptables-alerter-script\") pod \"iptables-alerter-594pr\" (UID: \"7a138cbd-bb6b-46be-9bcf-4d1030bfad2f\") " pod="openshift-network-operator/iptables-alerter-594pr" Jul 07 13:50:55.660215 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659409 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-host\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.660215 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659445 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b575ab4d-03cc-40e2-955b-c82bce6b2d63-ovn-node-metrics-cert\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.660215 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659468 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nln8c\" (UniqueName: \"kubernetes.io/projected/b575ab4d-03cc-40e2-955b-c82bce6b2d63-kube-api-access-nln8c\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.660215 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659508 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-host\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.660215 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659515 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-registration-dir\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.660215 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659544 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-device-dir\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.660215 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659576 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-var-lib-cni-multus\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.660215 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659614 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-modprobe-d\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.660215 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659623 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-registration-dir\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659642 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-run\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659610 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67f25601-a3a1-41ef-80da-a2a319e9e59d-tmp-dir\") pod \"node-resolver-zbsrw\" (UID: \"67f25601-a3a1-41ef-80da-a2a319e9e59d\") " pod="openshift-dns/node-resolver-zbsrw" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659671 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-device-dir\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659666 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b575ab4d-03cc-40e2-955b-c82bce6b2d63-ovnkube-config\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659713 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d77967e-57cd-4d6c-b943-c9bb72bbdf0f-konnectivity-ca\") pod \"konnectivity-agent-ppkhl\" (UID: \"1d77967e-57cd-4d6c-b943-c9bb72bbdf0f\") " pod="kube-system/konnectivity-agent-ppkhl" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659737 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe34b77f-15e4-43b5-a924-8fa943ca811e-cnibin\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659740 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-run\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659768 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgfcs\" (UniqueName: \"kubernetes.io/projected/7a138cbd-bb6b-46be-9bcf-4d1030bfad2f-kube-api-access-kgfcs\") pod \"iptables-alerter-594pr\" (UID: \"7a138cbd-bb6b-46be-9bcf-4d1030bfad2f\") " pod="openshift-network-operator/iptables-alerter-594pr" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659784 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-modprobe-d\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659819 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-sysctl-conf\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.659846 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660127 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7a138cbd-bb6b-46be-9bcf-4d1030bfad2f-iptables-alerter-script\") pod \"iptables-alerter-594pr\" (UID: \"7a138cbd-bb6b-46be-9bcf-4d1030bfad2f\") " pod="openshift-network-operator/iptables-alerter-594pr" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660311 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b575ab4d-03cc-40e2-955b-c82bce6b2d63-ovnkube-config\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660425 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-var-lib-kubelet\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660454 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-sysctl-conf\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660463 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-run-openvswitch\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660485 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-cni-bin\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.661152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660506 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-cnibin\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.661955 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660511 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-var-lib-kubelet\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.661955 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660539 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwlxn\" (UniqueName: \"kubernetes.io/projected/2319c840-63a7-450c-82be-66f05546af24-kube-api-access-dwlxn\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.661955 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660545 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-cni-bin\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.661955 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660583 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-var-lib-openvswitch\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.661955 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660613 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-run-openvswitch\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.661955 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660613 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe34b77f-15e4-43b5-a924-8fa943ca811e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.661955 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660663 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-var-lib-openvswitch\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.661955 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660688 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-log-socket\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.661955 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660713 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.661955 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660756 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-tuned\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.661955 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660754 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-log-socket\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.661955 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660772 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.661955 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660777 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-slash\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.661955 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660813 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-run-ovn-kubernetes\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.661955 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660815 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-slash\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.661955 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660850 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d77967e-57cd-4d6c-b943-c9bb72bbdf0f-konnectivity-ca\") pod \"konnectivity-agent-ppkhl\" (UID: \"1d77967e-57cd-4d6c-b943-c9bb72bbdf0f\") " pod="kube-system/konnectivity-agent-ppkhl" Jul 07 13:50:55.661955 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660852 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe34b77f-15e4-43b5-a924-8fa943ca811e-os-release\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.662797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660878 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-run-ovn-kubernetes\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.662797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660911 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ztcl\" (UniqueName: \"kubernetes.io/projected/67f25601-a3a1-41ef-80da-a2a319e9e59d-kube-api-access-8ztcl\") pod \"node-resolver-zbsrw\" (UID: \"67f25601-a3a1-41ef-80da-a2a319e9e59d\") " pod="openshift-dns/node-resolver-zbsrw" Jul 07 13:50:55.662797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660942 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret\") pod \"global-pull-secret-syncer-rwmks\" (UID: \"3c340622-81e7-4b51-806b-0aea3eb6394a\") " pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:50:55.662797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660969 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-sysctl-d\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.662797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.660993 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkbrk\" (UniqueName: \"kubernetes.io/projected/b8f2aa2b-7985-4363-84f5-bf0392006b46-kube-api-access-dkbrk\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.662797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661017 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-etc-selinux\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.662797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661048 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe34b77f-15e4-43b5-a924-8fa943ca811e-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.662797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661085 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv4l6\" (UniqueName: \"kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6\") pod \"network-check-target-2vwjz\" (UID: \"8dbec015-6c0e-4468-a867-d8cb583b8f6f\") " pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:50:55.662797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661106 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-os-release\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.662797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661108 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-sysctl-d\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.662797 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:55.661107 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:50:55.662797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661139 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/67f25601-a3a1-41ef-80da-a2a319e9e59d-hosts-file\") pod \"node-resolver-zbsrw\" (UID: \"67f25601-a3a1-41ef-80da-a2a319e9e59d\") " pod="openshift-dns/node-resolver-zbsrw" Jul 07 13:50:55.662797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661170 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-node-log\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.662797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661191 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00c54727-aa24-4646-9230-686cf45435be-etc-selinux\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.662797 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:55.661199 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret podName:3c340622-81e7-4b51-806b-0aea3eb6394a nodeName:}" failed. No retries permitted until 2026-07-07 13:50:56.161165111 +0000 UTC m=+3.026369573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret") pod "global-pull-secret-syncer-rwmks" (UID: "3c340622-81e7-4b51-806b-0aea3eb6394a") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:50:55.662797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661207 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-node-log\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.662797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661236 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b575ab4d-03cc-40e2-955b-c82bce6b2d63-env-overrides\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.663450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661278 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/67f25601-a3a1-41ef-80da-a2a319e9e59d-hosts-file\") pod \"node-resolver-zbsrw\" (UID: \"67f25601-a3a1-41ef-80da-a2a319e9e59d\") " pod="openshift-dns/node-resolver-zbsrw" Jul 07 13:50:55.663450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661327 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-var-lib-cni-bin\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.663450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661472 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe34b77f-15e4-43b5-a924-8fa943ca811e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.663450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661506 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pzxt\" (UniqueName: \"kubernetes.io/projected/25b6321b-a8db-4404-8e21-36dffa3f4585-kube-api-access-4pzxt\") pod \"network-metrics-daemon-jvz97\" (UID: \"25b6321b-a8db-4404-8e21-36dffa3f4585\") " pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:50:55.663450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661535 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-sysconfig\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.663450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661568 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-kubernetes\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.663450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661592 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8f2aa2b-7985-4363-84f5-bf0392006b46-tmp\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.663450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661618 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b575ab4d-03cc-40e2-955b-c82bce6b2d63-ovnkube-script-lib\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.663450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661618 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b575ab4d-03cc-40e2-955b-c82bce6b2d63-env-overrides\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.663450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661630 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-sysconfig\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.663450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661666 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-kubernetes\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.663450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661698 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d77967e-57cd-4d6c-b943-c9bb72bbdf0f-agent-certs\") pod \"konnectivity-agent-ppkhl\" (UID: \"1d77967e-57cd-4d6c-b943-c9bb72bbdf0f\") " pod="kube-system/konnectivity-agent-ppkhl" Jul 07 13:50:55.663450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661723 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b3f5fe49-2e39-4720-8e53-ba898c743f46-serviceca\") pod \"node-ca-rdm4s\" (UID: \"b3f5fe49-2e39-4720-8e53-ba898c743f46\") " pod="openshift-image-registry/node-ca-rdm4s" Jul 07 13:50:55.663450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661747 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-run-multus-certs\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.663450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-lib-modules\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.663450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661795 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-run-netns\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.663450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661823 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2319c840-63a7-450c-82be-66f05546af24-multus-daemon-config\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.664214 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661864 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lp6z\" (UniqueName: \"kubernetes.io/projected/fe34b77f-15e4-43b5-a924-8fa943ca811e-kube-api-access-2lp6z\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.664214 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661889 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs\") pod \"network-metrics-daemon-jvz97\" (UID: \"25b6321b-a8db-4404-8e21-36dffa3f4585\") " pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:50:55.664214 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.661913 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-systemd\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.664214 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.662059 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-lib-modules\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.664214 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.662100 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b575ab4d-03cc-40e2-955b-c82bce6b2d63-host-run-netns\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.664214 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.662146 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-systemd\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.664214 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.662165 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b575ab4d-03cc-40e2-955b-c82bce6b2d63-ovnkube-script-lib\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.664214 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.662349 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b3f5fe49-2e39-4720-8e53-ba898c743f46-serviceca\") pod \"node-ca-rdm4s\" (UID: \"b3f5fe49-2e39-4720-8e53-ba898c743f46\") " pod="openshift-image-registry/node-ca-rdm4s" Jul 07 13:50:55.664214 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.663814 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b8f2aa2b-7985-4363-84f5-bf0392006b46-etc-tuned\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.664214 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.663898 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b575ab4d-03cc-40e2-955b-c82bce6b2d63-ovn-node-metrics-cert\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.664615 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.664251 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8f2aa2b-7985-4363-84f5-bf0392006b46-tmp\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.664615 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.664275 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d77967e-57cd-4d6c-b943-c9bb72bbdf0f-agent-certs\") pod \"konnectivity-agent-ppkhl\" (UID: \"1d77967e-57cd-4d6c-b943-c9bb72bbdf0f\") " pod="kube-system/konnectivity-agent-ppkhl" Jul 07 13:50:55.666345 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.666322 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k476l\" (UniqueName: \"kubernetes.io/projected/b3f5fe49-2e39-4720-8e53-ba898c743f46-kube-api-access-k476l\") pod \"node-ca-rdm4s\" (UID: \"b3f5fe49-2e39-4720-8e53-ba898c743f46\") " pod="openshift-image-registry/node-ca-rdm4s" Jul 07 13:50:55.666607 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.666568 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrqbt\" (UniqueName: \"kubernetes.io/projected/00c54727-aa24-4646-9230-686cf45435be-kube-api-access-wrqbt\") pod \"aws-ebs-csi-driver-node-8g6rx\" (UID: \"00c54727-aa24-4646-9230-686cf45435be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.668747 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.668726 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgfcs\" (UniqueName: \"kubernetes.io/projected/7a138cbd-bb6b-46be-9bcf-4d1030bfad2f-kube-api-access-kgfcs\") pod \"iptables-alerter-594pr\" (UID: \"7a138cbd-bb6b-46be-9bcf-4d1030bfad2f\") " pod="openshift-network-operator/iptables-alerter-594pr" Jul 07 13:50:55.669335 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.669314 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ztcl\" (UniqueName: \"kubernetes.io/projected/67f25601-a3a1-41ef-80da-a2a319e9e59d-kube-api-access-8ztcl\") pod \"node-resolver-zbsrw\" (UID: \"67f25601-a3a1-41ef-80da-a2a319e9e59d\") " pod="openshift-dns/node-resolver-zbsrw" Jul 07 13:50:55.669559 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.669538 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nln8c\" (UniqueName: \"kubernetes.io/projected/b575ab4d-03cc-40e2-955b-c82bce6b2d63-kube-api-access-nln8c\") pod \"ovnkube-node-8d597\" (UID: \"b575ab4d-03cc-40e2-955b-c82bce6b2d63\") " pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.673114 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.673094 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkbrk\" (UniqueName: \"kubernetes.io/projected/b8f2aa2b-7985-4363-84f5-bf0392006b46-kube-api-access-dkbrk\") pod \"tuned-c7spc\" (UID: \"b8f2aa2b-7985-4363-84f5-bf0392006b46\") " pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.730807 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.730754 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" event={"ID":"83d0de89030d1dc32eced03342c2d0df","Type":"ContainerStarted","Data":"2976372efffcc41ca6e3255e7eb834a98cb2d649f94e4fc08def34d2f0110836"} Jul 07 13:50:55.731771 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.731740 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" event={"ID":"dc314882863d165c307bf7eda7756faa","Type":"ContainerStarted","Data":"948b1db930a64a9c84d5ad0ce0be92482dcd2ce25a8140d82262b71d4d7174f5"} Jul 07 13:50:55.763189 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763123 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-run-netns\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763189 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763152 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-hostroot\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763189 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763168 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-multus-conf-dir\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763189 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763182 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe34b77f-15e4-43b5-a924-8fa943ca811e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763204 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-multus-socket-dir-parent\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763226 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-run-k8s-cni-cncf-io\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763243 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-run-netns\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763247 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-var-lib-kubelet\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763267 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-multus-conf-dir\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763282 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-var-lib-kubelet\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763243 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-hostroot\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763293 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-etc-kubernetes\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763314 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-run-k8s-cni-cncf-io\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763323 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-etc-kubernetes\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763316 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-multus-socket-dir-parent\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763334 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-system-cni-dir\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763364 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-multus-cni-dir\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763375 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-system-cni-dir\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763379 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2319c840-63a7-450c-82be-66f05546af24-cni-binary-copy\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763409 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe34b77f-15e4-43b5-a924-8fa943ca811e-system-cni-dir\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763417 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe34b77f-15e4-43b5-a924-8fa943ca811e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.763469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763437 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-var-lib-cni-multus\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.764293 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763454 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-multus-cni-dir\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.764293 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763466 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe34b77f-15e4-43b5-a924-8fa943ca811e-cnibin\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.764293 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763474 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe34b77f-15e4-43b5-a924-8fa943ca811e-system-cni-dir\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.764293 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763491 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-var-lib-cni-multus\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.764293 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763505 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-cnibin\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.764293 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763514 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe34b77f-15e4-43b5-a924-8fa943ca811e-cnibin\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.764293 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763535 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwlxn\" (UniqueName: \"kubernetes.io/projected/2319c840-63a7-450c-82be-66f05546af24-kube-api-access-dwlxn\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.764293 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763562 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe34b77f-15e4-43b5-a924-8fa943ca811e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.764293 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763577 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-cnibin\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.764293 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763592 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe34b77f-15e4-43b5-a924-8fa943ca811e-os-release\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.764293 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763632 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe34b77f-15e4-43b5-a924-8fa943ca811e-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.764293 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763656 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv4l6\" (UniqueName: \"kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6\") pod \"network-check-target-2vwjz\" (UID: \"8dbec015-6c0e-4468-a867-d8cb583b8f6f\") " pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:50:55.764293 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763679 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-os-release\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.764293 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763703 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-var-lib-cni-bin\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.764293 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763726 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe34b77f-15e4-43b5-a924-8fa943ca811e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.764293 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763742 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe34b77f-15e4-43b5-a924-8fa943ca811e-os-release\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.764293 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763751 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pzxt\" (UniqueName: \"kubernetes.io/projected/25b6321b-a8db-4404-8e21-36dffa3f4585-kube-api-access-4pzxt\") pod \"network-metrics-daemon-jvz97\" (UID: \"25b6321b-a8db-4404-8e21-36dffa3f4585\") " pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:50:55.765165 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763803 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-run-multus-certs\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.765165 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763822 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-var-lib-cni-bin\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.765165 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763848 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2319c840-63a7-450c-82be-66f05546af24-multus-daemon-config\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.765165 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763876 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lp6z\" (UniqueName: \"kubernetes.io/projected/fe34b77f-15e4-43b5-a924-8fa943ca811e-kube-api-access-2lp6z\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.765165 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763901 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs\") pod \"network-metrics-daemon-jvz97\" (UID: \"25b6321b-a8db-4404-8e21-36dffa3f4585\") " pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:50:55.765165 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763905 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2319c840-63a7-450c-82be-66f05546af24-cni-binary-copy\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.765165 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.763910 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-os-release\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.765165 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.764102 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fe34b77f-15e4-43b5-a924-8fa943ca811e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.765165 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.764115 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2319c840-63a7-450c-82be-66f05546af24-host-run-multus-certs\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.765165 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:55.764190 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:50:55.765165 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:55.764245 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs podName:25b6321b-a8db-4404-8e21-36dffa3f4585 nodeName:}" failed. No retries permitted until 2026-07-07 13:50:56.264228829 +0000 UTC m=+3.129433277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs") pod "network-metrics-daemon-jvz97" (UID: "25b6321b-a8db-4404-8e21-36dffa3f4585") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:50:55.765165 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.764396 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fe34b77f-15e4-43b5-a924-8fa943ca811e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.765165 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.764423 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2319c840-63a7-450c-82be-66f05546af24-multus-daemon-config\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.765165 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.764446 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe34b77f-15e4-43b5-a924-8fa943ca811e-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.770362 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:55.770337 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:50:55.770362 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:55.770360 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:50:55.770533 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:55.770373 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fv4l6 for pod openshift-network-diagnostics/network-check-target-2vwjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:50:55.770533 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:55.770444 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6 podName:8dbec015-6c0e-4468-a867-d8cb583b8f6f nodeName:}" failed. No retries permitted until 2026-07-07 13:50:56.27042872 +0000 UTC m=+3.135633166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fv4l6" (UniqueName: "kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6") pod "network-check-target-2vwjz" (UID: "8dbec015-6c0e-4468-a867-d8cb583b8f6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:50:55.772472 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.772453 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwlxn\" (UniqueName: \"kubernetes.io/projected/2319c840-63a7-450c-82be-66f05546af24-kube-api-access-dwlxn\") pod \"multus-6jlvw\" (UID: \"2319c840-63a7-450c-82be-66f05546af24\") " pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.772697 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.772676 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lp6z\" (UniqueName: \"kubernetes.io/projected/fe34b77f-15e4-43b5-a924-8fa943ca811e-kube-api-access-2lp6z\") pod \"multus-additional-cni-plugins-xqzcq\" (UID: \"fe34b77f-15e4-43b5-a924-8fa943ca811e\") " pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:55.772760 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.772730 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pzxt\" (UniqueName: \"kubernetes.io/projected/25b6321b-a8db-4404-8e21-36dffa3f4585-kube-api-access-4pzxt\") pod \"network-metrics-daemon-jvz97\" (UID: \"25b6321b-a8db-4404-8e21-36dffa3f4585\") " pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:50:55.804502 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.804471 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:50:55.838844 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.838796 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c7spc" Jul 07 13:50:55.847582 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.847552 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-594pr" Jul 07 13:50:55.858731 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.858708 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:50:55.864557 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.864538 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ppkhl" Jul 07 13:50:55.870373 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.870356 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" Jul 07 13:50:55.877031 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.877008 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zbsrw" Jul 07 13:50:55.883804 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.883786 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rdm4s" Jul 07 13:50:55.890675 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.890651 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6jlvw" Jul 07 13:50:55.897418 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:55.897397 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xqzcq" Jul 07 13:50:56.166348 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:56.166276 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret\") pod \"global-pull-secret-syncer-rwmks\" (UID: \"3c340622-81e7-4b51-806b-0aea3eb6394a\") " pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:50:56.166487 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:56.166450 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:50:56.166542 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:56.166523 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret podName:3c340622-81e7-4b51-806b-0aea3eb6394a nodeName:}" failed. No retries permitted until 2026-07-07 13:50:57.166502957 +0000 UTC m=+4.031707420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret") pod "global-pull-secret-syncer-rwmks" (UID: "3c340622-81e7-4b51-806b-0aea3eb6394a") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:50:56.267059 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:56.267023 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs\") pod \"network-metrics-daemon-jvz97\" (UID: \"25b6321b-a8db-4404-8e21-36dffa3f4585\") " pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:50:56.267217 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:56.267166 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:50:56.267257 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:56.267222 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs podName:25b6321b-a8db-4404-8e21-36dffa3f4585 nodeName:}" failed. No retries permitted until 2026-07-07 13:50:57.267208407 +0000 UTC m=+4.132412849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs") pod "network-metrics-daemon-jvz97" (UID: "25b6321b-a8db-4404-8e21-36dffa3f4585") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:50:56.368214 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:56.368182 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv4l6\" (UniqueName: \"kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6\") pod \"network-check-target-2vwjz\" (UID: \"8dbec015-6c0e-4468-a867-d8cb583b8f6f\") " pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:50:56.368397 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:56.368332 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:50:56.368397 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:56.368350 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:50:56.368397 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:56.368361 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fv4l6 for pod openshift-network-diagnostics/network-check-target-2vwjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:50:56.368524 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:56.368418 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6 podName:8dbec015-6c0e-4468-a867-d8cb583b8f6f nodeName:}" failed. No retries permitted until 2026-07-07 13:50:57.368401558 +0000 UTC m=+4.233606013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fv4l6" (UniqueName: "kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6") pod "network-check-target-2vwjz" (UID: "8dbec015-6c0e-4468-a867-d8cb583b8f6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:50:56.525751 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:56.525706 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d77967e_57cd_4d6c_b943_c9bb72bbdf0f.slice/crio-2273b9a93f9a3963284d52c04542640f83b1a6c3543c1e50401bbf3267f34dc1 WatchSource:0}: Error finding container 2273b9a93f9a3963284d52c04542640f83b1a6c3543c1e50401bbf3267f34dc1: Status 404 returned error can't find the container with id 2273b9a93f9a3963284d52c04542640f83b1a6c3543c1e50401bbf3267f34dc1 Jul 07 13:50:56.527284 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:56.527260 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f2aa2b_7985_4363_84f5_bf0392006b46.slice/crio-c0077648753bbc59c884f6d80029ae4c5fcf710d4c487653761f08434f668297 WatchSource:0}: Error finding container c0077648753bbc59c884f6d80029ae4c5fcf710d4c487653761f08434f668297: Status 404 returned error can't find the container with id c0077648753bbc59c884f6d80029ae4c5fcf710d4c487653761f08434f668297 Jul 07 13:50:56.529007 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:56.528989 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a138cbd_bb6b_46be_9bcf_4d1030bfad2f.slice/crio-6789229c576e5efbf795c62579437d57f3a422a2245284a5509393dee9630dd8 WatchSource:0}: Error finding container 6789229c576e5efbf795c62579437d57f3a422a2245284a5509393dee9630dd8: Status 404 returned error can't find the container with id 6789229c576e5efbf795c62579437d57f3a422a2245284a5509393dee9630dd8 Jul 07 13:50:56.531369 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:56.531293 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe34b77f_15e4_43b5_a924_8fa943ca811e.slice/crio-a6ef8aca28f112464aacb13d2f4cbc2a6326dd080236fa51916fcb40b4342c75 WatchSource:0}: Error finding container a6ef8aca28f112464aacb13d2f4cbc2a6326dd080236fa51916fcb40b4342c75: Status 404 returned error can't find the container with id a6ef8aca28f112464aacb13d2f4cbc2a6326dd080236fa51916fcb40b4342c75 Jul 07 13:50:56.532009 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:56.531989 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00c54727_aa24_4646_9230_686cf45435be.slice/crio-fe2dd950df5f8e25d40af3e3e96065d904521b2b700e583fea1c4bbf54dfee77 WatchSource:0}: Error finding container fe2dd950df5f8e25d40af3e3e96065d904521b2b700e583fea1c4bbf54dfee77: Status 404 returned error can't find the container with id fe2dd950df5f8e25d40af3e3e96065d904521b2b700e583fea1c4bbf54dfee77 Jul 07 13:50:56.533487 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:56.533426 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb575ab4d_03cc_40e2_955b_c82bce6b2d63.slice/crio-21b9936c37cab772a35ddc6a1178a007a6fc3aef3004c18afc3fd8f857bd1070 WatchSource:0}: Error finding container 21b9936c37cab772a35ddc6a1178a007a6fc3aef3004c18afc3fd8f857bd1070: Status 404 returned error can't find the container with id 21b9936c37cab772a35ddc6a1178a007a6fc3aef3004c18afc3fd8f857bd1070 Jul 07 13:50:56.534604 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:56.534574 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f25601_a3a1_41ef_80da_a2a319e9e59d.slice/crio-22ea6eea7ebee7818ab70330095479db5f03cace2b68e06d44976ace82f8a904 WatchSource:0}: Error finding container 22ea6eea7ebee7818ab70330095479db5f03cace2b68e06d44976ace82f8a904: Status 404 returned error can't find the container with id 22ea6eea7ebee7818ab70330095479db5f03cace2b68e06d44976ace82f8a904 Jul 07 13:50:56.536146 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:56.535741 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2319c840_63a7_450c_82be_66f05546af24.slice/crio-9dc91cee66feaa2e5ae54b469c6ff4e376dced424f99f28087cf897679329625 WatchSource:0}: Error finding container 9dc91cee66feaa2e5ae54b469c6ff4e376dced424f99f28087cf897679329625: Status 404 returned error can't find the container with id 9dc91cee66feaa2e5ae54b469c6ff4e376dced424f99f28087cf897679329625 Jul 07 13:50:56.536586 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:50:56.536570 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f5fe49_2e39_4720_8e53_ba898c743f46.slice/crio-662dc02787f8798efa53ff3fda7d08248d3a4cf2e23c72215945dbeaa7d06694 WatchSource:0}: Error finding container 662dc02787f8798efa53ff3fda7d08248d3a4cf2e23c72215945dbeaa7d06694: Status 404 returned error can't find the container with id 662dc02787f8798efa53ff3fda7d08248d3a4cf2e23c72215945dbeaa7d06694 Jul 07 13:50:56.594687 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:56.594513 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 13:45:55 +0000 UTC" deadline="2028-03-11 09:26:50.061729986 +0000 UTC" Jul 07 13:50:56.594687 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:56.594682 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14707h35m53.467050595s" Jul 07 13:50:56.727193 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:56.727160 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:50:56.727352 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:56.727292 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:50:56.734503 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:56.734474 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rdm4s" event={"ID":"b3f5fe49-2e39-4720-8e53-ba898c743f46","Type":"ContainerStarted","Data":"662dc02787f8798efa53ff3fda7d08248d3a4cf2e23c72215945dbeaa7d06694"} Jul 07 13:50:56.735753 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:56.735728 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" event={"ID":"b575ab4d-03cc-40e2-955b-c82bce6b2d63","Type":"ContainerStarted","Data":"21b9936c37cab772a35ddc6a1178a007a6fc3aef3004c18afc3fd8f857bd1070"} Jul 07 13:50:56.736871 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:56.736851 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" event={"ID":"00c54727-aa24-4646-9230-686cf45435be","Type":"ContainerStarted","Data":"fe2dd950df5f8e25d40af3e3e96065d904521b2b700e583fea1c4bbf54dfee77"} Jul 07 13:50:56.737982 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:56.737962 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c7spc" event={"ID":"b8f2aa2b-7985-4363-84f5-bf0392006b46","Type":"ContainerStarted","Data":"c0077648753bbc59c884f6d80029ae4c5fcf710d4c487653761f08434f668297"} Jul 07 13:50:56.739126 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:56.739107 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ppkhl" event={"ID":"1d77967e-57cd-4d6c-b943-c9bb72bbdf0f","Type":"ContainerStarted","Data":"2273b9a93f9a3963284d52c04542640f83b1a6c3543c1e50401bbf3267f34dc1"} Jul 07 13:50:56.740999 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:56.740975 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" event={"ID":"dc314882863d165c307bf7eda7756faa","Type":"ContainerStarted","Data":"878f8e1c725bbb572847f2c22fc24a71ee760039d7a1f031853186afd1dbe8dd"} Jul 07 13:50:56.742082 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:56.742062 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6jlvw" event={"ID":"2319c840-63a7-450c-82be-66f05546af24","Type":"ContainerStarted","Data":"9dc91cee66feaa2e5ae54b469c6ff4e376dced424f99f28087cf897679329625"} Jul 07 13:50:56.743122 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:56.743095 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zbsrw" event={"ID":"67f25601-a3a1-41ef-80da-a2a319e9e59d","Type":"ContainerStarted","Data":"22ea6eea7ebee7818ab70330095479db5f03cace2b68e06d44976ace82f8a904"} Jul 07 13:50:56.744288 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:56.744227 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqzcq" event={"ID":"fe34b77f-15e4-43b5-a924-8fa943ca811e","Type":"ContainerStarted","Data":"a6ef8aca28f112464aacb13d2f4cbc2a6326dd080236fa51916fcb40b4342c75"} Jul 07 13:50:56.745289 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:56.745260 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-594pr" event={"ID":"7a138cbd-bb6b-46be-9bcf-4d1030bfad2f","Type":"ContainerStarted","Data":"6789229c576e5efbf795c62579437d57f3a422a2245284a5509393dee9630dd8"} Jul 07 13:50:56.754764 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:56.754682 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-38.ec2.internal" podStartSLOduration=2.754670801 podStartE2EDuration="2.754670801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:50:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:50:56.754220425 +0000 UTC m=+3.619424888" watchObservedRunningTime="2026-07-07 13:50:56.754670801 +0000 UTC m=+3.619875264" Jul 07 13:50:57.173987 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:57.173949 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret\") pod \"global-pull-secret-syncer-rwmks\" (UID: \"3c340622-81e7-4b51-806b-0aea3eb6394a\") " pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:50:57.174146 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:57.174130 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:50:57.174205 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:57.174195 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret podName:3c340622-81e7-4b51-806b-0aea3eb6394a nodeName:}" failed. No retries permitted until 2026-07-07 13:50:59.174178297 +0000 UTC m=+6.039382743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret") pod "global-pull-secret-syncer-rwmks" (UID: "3c340622-81e7-4b51-806b-0aea3eb6394a") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:50:57.274858 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:57.274459 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs\") pod \"network-metrics-daemon-jvz97\" (UID: \"25b6321b-a8db-4404-8e21-36dffa3f4585\") " pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:50:57.274858 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:57.274628 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:50:57.274858 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:57.274689 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs podName:25b6321b-a8db-4404-8e21-36dffa3f4585 nodeName:}" failed. No retries permitted until 2026-07-07 13:50:59.274671286 +0000 UTC m=+6.139875742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs") pod "network-metrics-daemon-jvz97" (UID: "25b6321b-a8db-4404-8e21-36dffa3f4585") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:50:57.375022 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:57.374977 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv4l6\" (UniqueName: \"kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6\") pod \"network-check-target-2vwjz\" (UID: \"8dbec015-6c0e-4468-a867-d8cb583b8f6f\") " pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:50:57.375247 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:57.375229 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:50:57.375338 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:57.375255 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:50:57.375338 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:57.375271 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fv4l6 for pod openshift-network-diagnostics/network-check-target-2vwjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:50:57.375434 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:57.375334 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6 podName:8dbec015-6c0e-4468-a867-d8cb583b8f6f nodeName:}" failed. No retries permitted until 2026-07-07 13:50:59.375312907 +0000 UTC m=+6.240517375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fv4l6" (UniqueName: "kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6") pod "network-check-target-2vwjz" (UID: "8dbec015-6c0e-4468-a867-d8cb583b8f6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:50:57.595264 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:57.595218 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 13:45:55 +0000 UTC" deadline="2028-01-07 09:02:59.249177113 +0000 UTC" Jul 07 13:50:57.595264 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:57.595260 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13171h12m1.653921346s" Jul 07 13:50:57.730343 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:57.730267 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:50:57.730493 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:57.730398 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:50:57.730802 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:57.730780 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:50:57.730933 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:57.730911 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:50:57.761845 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:57.761803 2560 generic.go:356] "Generic (PLEG): container finished" podID="83d0de89030d1dc32eced03342c2d0df" containerID="54d82a1dff35232276360beae2a81d600b53f3fa5b0d7d6585404d3b700d5277" exitCode=0 Jul 07 13:50:57.762707 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:57.762681 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" event={"ID":"83d0de89030d1dc32eced03342c2d0df","Type":"ContainerDied","Data":"54d82a1dff35232276360beae2a81d600b53f3fa5b0d7d6585404d3b700d5277"} Jul 07 13:50:58.727920 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:58.727885 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:50:58.728375 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:58.728028 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:50:58.771026 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:58.770985 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" event={"ID":"83d0de89030d1dc32eced03342c2d0df","Type":"ContainerStarted","Data":"293ac6da1c7f5451cb15a8fd17b1749bfdfb932a0891f8b9da14d57dfd5cf89a"} Jul 07 13:50:59.192889 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:59.192797 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret\") pod \"global-pull-secret-syncer-rwmks\" (UID: \"3c340622-81e7-4b51-806b-0aea3eb6394a\") " pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:50:59.193056 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:59.192974 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:50:59.193056 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:59.193035 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret podName:3c340622-81e7-4b51-806b-0aea3eb6394a nodeName:}" failed. No retries permitted until 2026-07-07 13:51:03.193018836 +0000 UTC m=+10.058223282 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret") pod "global-pull-secret-syncer-rwmks" (UID: "3c340622-81e7-4b51-806b-0aea3eb6394a") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:50:59.293721 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:59.293688 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs\") pod \"network-metrics-daemon-jvz97\" (UID: \"25b6321b-a8db-4404-8e21-36dffa3f4585\") " pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:50:59.293918 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:59.293820 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:50:59.293918 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:59.293897 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs podName:25b6321b-a8db-4404-8e21-36dffa3f4585 nodeName:}" failed. No retries permitted until 2026-07-07 13:51:03.293880345 +0000 UTC m=+10.159084788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs") pod "network-metrics-daemon-jvz97" (UID: "25b6321b-a8db-4404-8e21-36dffa3f4585") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:50:59.393989 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:59.393957 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv4l6\" (UniqueName: \"kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6\") pod \"network-check-target-2vwjz\" (UID: \"8dbec015-6c0e-4468-a867-d8cb583b8f6f\") " pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:50:59.394166 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:59.394141 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:50:59.394166 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:59.394165 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:50:59.394290 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:59.394177 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fv4l6 for pod openshift-network-diagnostics/network-check-target-2vwjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:50:59.394290 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:59.394227 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6 podName:8dbec015-6c0e-4468-a867-d8cb583b8f6f nodeName:}" failed. No retries permitted until 2026-07-07 13:51:03.394208388 +0000 UTC m=+10.259412831 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fv4l6" (UniqueName: "kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6") pod "network-check-target-2vwjz" (UID: "8dbec015-6c0e-4468-a867-d8cb583b8f6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:50:59.727688 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:59.727658 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:50:59.727900 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:59.727798 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:50:59.734140 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:50:59.733902 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:50:59.734140 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:50:59.734089 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:51:00.727123 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:00.727069 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:00.727292 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:00.727196 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:51:01.728170 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:01.727366 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:01.728170 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:01.727525 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:51:01.728170 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:01.727971 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:01.728170 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:01.728081 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:51:02.727757 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:02.727717 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:02.727990 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:02.727876 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:51:03.225698 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:03.225578 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret\") pod \"global-pull-secret-syncer-rwmks\" (UID: \"3c340622-81e7-4b51-806b-0aea3eb6394a\") " pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:03.226202 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:03.225733 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:51:03.226202 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:03.225799 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret podName:3c340622-81e7-4b51-806b-0aea3eb6394a nodeName:}" failed. No retries permitted until 2026-07-07 13:51:11.225781064 +0000 UTC m=+18.090985522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret") pod "global-pull-secret-syncer-rwmks" (UID: "3c340622-81e7-4b51-806b-0aea3eb6394a") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:51:03.326429 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:03.326373 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs\") pod \"network-metrics-daemon-jvz97\" (UID: \"25b6321b-a8db-4404-8e21-36dffa3f4585\") " pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:03.326600 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:03.326547 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:51:03.326669 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:03.326608 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs podName:25b6321b-a8db-4404-8e21-36dffa3f4585 nodeName:}" failed. No retries permitted until 2026-07-07 13:51:11.326588149 +0000 UTC m=+18.191792591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs") pod "network-metrics-daemon-jvz97" (UID: "25b6321b-a8db-4404-8e21-36dffa3f4585") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:51:03.427876 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:03.427820 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv4l6\" (UniqueName: \"kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6\") pod \"network-check-target-2vwjz\" (UID: \"8dbec015-6c0e-4468-a867-d8cb583b8f6f\") " pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:03.428051 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:03.427989 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:51:03.428051 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:03.428018 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:51:03.428051 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:03.428030 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fv4l6 for pod openshift-network-diagnostics/network-check-target-2vwjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:51:03.428208 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:03.428101 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6 podName:8dbec015-6c0e-4468-a867-d8cb583b8f6f nodeName:}" failed. No retries permitted until 2026-07-07 13:51:11.428082175 +0000 UTC m=+18.293286621 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fv4l6" (UniqueName: "kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6") pod "network-check-target-2vwjz" (UID: "8dbec015-6c0e-4468-a867-d8cb583b8f6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:51:03.728850 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:03.728809 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:03.729010 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:03.728950 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:51:03.729451 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:03.729374 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:03.729564 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:03.729491 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:51:04.727420 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:04.727386 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:04.727938 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:04.727515 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:51:05.727715 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:05.727658 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:05.728200 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:05.727794 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:51:05.728200 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:05.727842 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:05.728200 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:05.727938 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:51:06.727842 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:06.727795 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:06.728144 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:06.727913 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:51:07.727674 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:07.727642 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:07.727847 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:07.727772 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:51:07.727915 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:07.727849 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:07.728220 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:07.727946 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:51:08.727072 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:08.727041 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:08.727238 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:08.727168 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:51:09.727472 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:09.727433 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:09.727981 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:09.727445 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:09.727981 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:09.727589 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:51:09.727981 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:09.727691 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:51:10.728066 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:10.727977 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:10.728498 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:10.728104 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:51:11.285277 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:11.285236 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret\") pod \"global-pull-secret-syncer-rwmks\" (UID: \"3c340622-81e7-4b51-806b-0aea3eb6394a\") " pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:11.285473 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:11.285409 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:51:11.285473 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:11.285471 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret podName:3c340622-81e7-4b51-806b-0aea3eb6394a nodeName:}" failed. No retries permitted until 2026-07-07 13:51:27.285453199 +0000 UTC m=+34.150657658 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret") pod "global-pull-secret-syncer-rwmks" (UID: "3c340622-81e7-4b51-806b-0aea3eb6394a") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:51:11.386671 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:11.386624 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs\") pod \"network-metrics-daemon-jvz97\" (UID: \"25b6321b-a8db-4404-8e21-36dffa3f4585\") " pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:11.386888 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:11.386778 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:51:11.386888 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:11.386869 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs podName:25b6321b-a8db-4404-8e21-36dffa3f4585 nodeName:}" failed. No retries permitted until 2026-07-07 13:51:27.38684862 +0000 UTC m=+34.252053076 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs") pod "network-metrics-daemon-jvz97" (UID: "25b6321b-a8db-4404-8e21-36dffa3f4585") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:51:11.487523 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:11.487488 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv4l6\" (UniqueName: \"kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6\") pod \"network-check-target-2vwjz\" (UID: \"8dbec015-6c0e-4468-a867-d8cb583b8f6f\") " pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:11.487689 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:11.487640 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:51:11.487689 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:11.487663 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:51:11.487689 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:11.487673 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fv4l6 for pod openshift-network-diagnostics/network-check-target-2vwjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:51:11.487927 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:11.487723 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6 podName:8dbec015-6c0e-4468-a867-d8cb583b8f6f nodeName:}" failed. No retries permitted until 2026-07-07 13:51:27.487710272 +0000 UTC m=+34.352914721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fv4l6" (UniqueName: "kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6") pod "network-check-target-2vwjz" (UID: "8dbec015-6c0e-4468-a867-d8cb583b8f6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:51:11.727311 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:11.727231 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:11.727470 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:11.727240 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:11.727470 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:11.727398 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:51:11.727470 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:11.727422 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:51:12.727465 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:12.727438 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:12.727860 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:12.727541 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:51:13.730720 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:13.730690 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:13.731181 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:13.730804 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:51:13.731181 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:13.730856 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:13.731181 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:13.730962 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:51:14.727894 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:14.727861 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:14.728020 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:14.727987 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:51:15.727912 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.727510 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:15.728505 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.727536 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:15.728505 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:15.728045 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:51:15.728505 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:15.728150 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:51:15.809471 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.809430 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rdm4s" event={"ID":"b3f5fe49-2e39-4720-8e53-ba898c743f46","Type":"ContainerStarted","Data":"739b8b000f92b5bc375e69cb0c099d8f66dc77ff60412066684dd48a8092a3d8"} Jul 07 13:51:15.812883 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.812860 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8d597_b575ab4d-03cc-40e2-955b-c82bce6b2d63/ovn-acl-logging/0.log" Jul 07 13:51:15.813327 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.813297 2560 generic.go:356] "Generic (PLEG): container finished" podID="b575ab4d-03cc-40e2-955b-c82bce6b2d63" containerID="90297603f1a56990de7b356f3d64c2c6318bf1fb9c2c579a9b27a1da3fec7f01" exitCode=1 Jul 07 13:51:15.813431 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.813364 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" event={"ID":"b575ab4d-03cc-40e2-955b-c82bce6b2d63","Type":"ContainerStarted","Data":"386f94219e18c592c984fae02b9c0bfbc1177684440382bf57519304a97eeb15"} Jul 07 13:51:15.813478 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.813454 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" event={"ID":"b575ab4d-03cc-40e2-955b-c82bce6b2d63","Type":"ContainerStarted","Data":"105fb6a0e23823e42c8a34eb86b1083e4c7643541e93e7498af31d134c8c37b8"} Jul 07 13:51:15.813528 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.813507 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" event={"ID":"b575ab4d-03cc-40e2-955b-c82bce6b2d63","Type":"ContainerStarted","Data":"bfba1fdd66dde5ae9b26bff6c4275c3e4dbf42e793183951577ae4ffe7f2ad19"} Jul 07 13:51:15.813575 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.813554 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" event={"ID":"b575ab4d-03cc-40e2-955b-c82bce6b2d63","Type":"ContainerStarted","Data":"7ede7e8060a9efa1a5b4c90914e8ef4edc6ac07ffe73eaf3d0cf115dd4856ba3"} Jul 07 13:51:15.813622 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.813597 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" event={"ID":"b575ab4d-03cc-40e2-955b-c82bce6b2d63","Type":"ContainerDied","Data":"90297603f1a56990de7b356f3d64c2c6318bf1fb9c2c579a9b27a1da3fec7f01"} Jul 07 13:51:15.813671 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.813632 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" event={"ID":"b575ab4d-03cc-40e2-955b-c82bce6b2d63","Type":"ContainerStarted","Data":"b90de9bf943a1d5d8b987b6b8773f5c73c61467d07700ce11a64a9bd293ba7a7"} Jul 07 13:51:15.814975 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.814953 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" event={"ID":"00c54727-aa24-4646-9230-686cf45435be","Type":"ContainerStarted","Data":"ab805dea6681b2a70206320980d58d1760bf2ac66da5ae7c716ee8b457535c56"} Jul 07 13:51:15.816436 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.816404 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c7spc" event={"ID":"b8f2aa2b-7985-4363-84f5-bf0392006b46","Type":"ContainerStarted","Data":"368ba6d01a6c2f919bd0c4b3188f38f08bd9c70bc977bb0f3a83ea62f4c87a90"} Jul 07 13:51:15.818438 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.818415 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ppkhl" event={"ID":"1d77967e-57cd-4d6c-b943-c9bb72bbdf0f","Type":"ContainerStarted","Data":"9d470e96cb0c6bc584f70cf61b54543507b31b20807743d818a598af7a14a61f"} Jul 07 13:51:15.820163 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.820122 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6jlvw" event={"ID":"2319c840-63a7-450c-82be-66f05546af24","Type":"ContainerStarted","Data":"90d14696d9630c0c657250147934056d43ad5d45c165524e59f0cc7533bf3750"} Jul 07 13:51:15.821776 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.821732 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zbsrw" event={"ID":"67f25601-a3a1-41ef-80da-a2a319e9e59d","Type":"ContainerStarted","Data":"53f88013b34a8d51ecd96d5e3f53191a48388c828d82c5170a3a8a2e705ad007"} Jul 07 13:51:15.825364 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.825336 2560 generic.go:356] "Generic (PLEG): container finished" podID="fe34b77f-15e4-43b5-a924-8fa943ca811e" containerID="92c6d5071944c806aff4491b80151fbb12e672278a8e164306406902db66c763" exitCode=0 Jul 07 13:51:15.825466 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.825369 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqzcq" event={"ID":"fe34b77f-15e4-43b5-a924-8fa943ca811e","Type":"ContainerDied","Data":"92c6d5071944c806aff4491b80151fbb12e672278a8e164306406902db66c763"} Jul 07 13:51:15.829110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.829065 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-38.ec2.internal" podStartSLOduration=21.829048443 podStartE2EDuration="21.829048443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:50:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:50:58.789295558 +0000 UTC m=+5.654500004" watchObservedRunningTime="2026-07-07 13:51:15.829048443 +0000 UTC m=+22.694252909" Jul 07 13:51:15.829470 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.829443 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rdm4s" podStartSLOduration=4.660698279 podStartE2EDuration="22.829433323s" totalImagesPullingTime="18.168735044s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:51:15.828787385 +0000 UTC m=+22.693991872" watchObservedRunningTime="2026-07-07 13:51:15.829433323 +0000 UTC m=+22.694637787" Jul 07 13:51:15.848790 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.848749 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c7spc" podStartSLOduration=4.646080719 podStartE2EDuration="22.84873349s" totalImagesPullingTime="18.202652771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:51:15.848494971 +0000 UTC m=+22.713699453" watchObservedRunningTime="2026-07-07 13:51:15.84873349 +0000 UTC m=+22.713937953" Jul 07 13:51:15.867068 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.867020 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ppkhl" podStartSLOduration=9.084916734 podStartE2EDuration="22.867006175s" totalImagesPullingTime="13.782089441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:51:15.866904562 +0000 UTC m=+22.732109045" watchObservedRunningTime="2026-07-07 13:51:15.867006175 +0000 UTC m=+22.732210638" Jul 07 13:51:15.889434 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.889381 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zbsrw" podStartSLOduration=4.692092403 podStartE2EDuration="22.889361574s" totalImagesPullingTime="18.197269171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:51:15.88869121 +0000 UTC m=+22.753895696" watchObservedRunningTime="2026-07-07 13:51:15.889361574 +0000 UTC m=+22.754566040" Jul 07 13:51:15.906351 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:15.906270 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6jlvw" podStartSLOduration=4.707562649 podStartE2EDuration="22.906254814s" totalImagesPullingTime="18.198692165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:51:15.906076299 +0000 UTC m=+22.771280787" watchObservedRunningTime="2026-07-07 13:51:15.906254814 +0000 UTC m=+22.771459280" Jul 07 13:51:16.073895 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:16.073868 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ppkhl" Jul 07 13:51:16.074506 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:16.074491 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ppkhl" Jul 07 13:51:16.209511 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:16.209489 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 13:51:16.615689 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:16.615548 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T13:51:16.209506504Z","UUID":"3c6dfd05-3de3-44be-92de-41639c7c18fd","Handler":null,"Name":"","Endpoint":""} Jul 07 13:51:16.617195 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:16.617164 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 13:51:16.617333 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:16.617208 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 13:51:16.727416 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:16.727381 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:16.727589 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:16.727482 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:51:16.829342 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:16.829290 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-594pr" event={"ID":"7a138cbd-bb6b-46be-9bcf-4d1030bfad2f","Type":"ContainerStarted","Data":"43457f84fe7e7ee0ba684a343fdd47a7ab46ff1a9f71d5e9d5d008e65e3bd932"} Jul 07 13:51:16.831146 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:16.831113 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" event={"ID":"00c54727-aa24-4646-9230-686cf45435be","Type":"ContainerStarted","Data":"8dfa4e9fa44bced9e9076699b8205767bd6d2efc865cdfaaf94958808e9ec5f4"} Jul 07 13:51:16.831745 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:16.831726 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ppkhl" Jul 07 13:51:16.832068 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:16.832054 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ppkhl" Jul 07 13:51:16.844630 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:16.844583 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-594pr" podStartSLOduration=5.682395003 podStartE2EDuration="23.844565674s" totalImagesPullingTime="18.162170671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:51:16.844354257 +0000 UTC m=+23.709558742" watchObservedRunningTime="2026-07-07 13:51:16.844565674 +0000 UTC m=+23.709770138" Jul 07 13:51:17.727784 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:17.727750 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:17.727953 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:17.727902 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:51:17.727953 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:17.727943 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:17.728082 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:17.728058 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:51:18.727525 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:18.727345 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:18.728000 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:18.727612 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:51:18.842194 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:18.842167 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8d597_b575ab4d-03cc-40e2-955b-c82bce6b2d63/ovn-acl-logging/0.log" Jul 07 13:51:18.842584 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:18.842555 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" event={"ID":"b575ab4d-03cc-40e2-955b-c82bce6b2d63","Type":"ContainerStarted","Data":"00290d3db18a177a0f24ee8134514bb31cd5cbaf16be76413cd7e373fb8f1dec"} Jul 07 13:51:18.845164 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:18.845133 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" event={"ID":"00c54727-aa24-4646-9230-686cf45435be","Type":"ContainerStarted","Data":"ed062779ef197a4d2ccd4a08ae6d66708a90ab492bd9551ababdba7cf2a8c26a"} Jul 07 13:51:18.864478 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:18.864433 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6rx" podStartSLOduration=5.054409467 podStartE2EDuration="25.864419456s" totalImagesPullingTime="20.810009989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:50:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:51:18.863452095 +0000 UTC m=+25.728656559" watchObservedRunningTime="2026-07-07 13:51:18.864419456 +0000 UTC m=+25.729623919" Jul 07 13:51:19.727296 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:19.727264 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:19.727485 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:19.727263 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:19.727485 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:19.727389 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:51:19.727987 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:19.727501 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:51:20.727060 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:20.727020 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:20.727255 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:20.727149 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:51:20.853745 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:20.853719 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8d597_b575ab4d-03cc-40e2-955b-c82bce6b2d63/ovn-acl-logging/0.log" Jul 07 13:51:20.854373 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:20.854171 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" event={"ID":"b575ab4d-03cc-40e2-955b-c82bce6b2d63","Type":"ContainerStarted","Data":"3c1a716e9f473c79e2b4532a34bf2cfcc1262181162ac0889a05e8de0b213562"} Jul 07 13:51:20.854649 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:20.854471 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:51:20.854772 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:20.854709 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:51:20.854772 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:20.854711 2560 scope.go:117] "RemoveContainer" containerID="90297603f1a56990de7b356f3d64c2c6318bf1fb9c2c579a9b27a1da3fec7f01" Jul 07 13:51:20.872326 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:20.872304 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:51:21.727873 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:21.727781 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:21.728039 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:21.727918 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:51:21.728039 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:21.727987 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:21.728200 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:21.728137 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:51:21.861941 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:21.861917 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8d597_b575ab4d-03cc-40e2-955b-c82bce6b2d63/ovn-acl-logging/0.log" Jul 07 13:51:21.862355 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:21.862326 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" event={"ID":"b575ab4d-03cc-40e2-955b-c82bce6b2d63","Type":"ContainerStarted","Data":"316fa1676cc5d602ac8e0cb7fc07a92774b2dc1752ea827ec7fc9047e237b7f1"} Jul 07 13:51:21.862794 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:21.862711 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:51:21.879252 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:21.879226 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:51:21.893142 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:21.893093 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" podStartSLOduration=10.267870257 podStartE2EDuration="28.893077581s" totalImagesPullingTime="18.625207324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:51:21.891682473 +0000 UTC m=+28.756886955" watchObservedRunningTime="2026-07-07 13:51:21.893077581 +0000 UTC m=+28.758282046" Jul 07 13:51:22.032321 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:22.032242 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rwmks"] Jul 07 13:51:22.032466 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:22.032360 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:22.032541 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:22.032505 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:51:22.035599 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:22.035571 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jvz97"] Jul 07 13:51:22.035741 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:22.035679 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:22.035810 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:22.035791 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:51:22.047581 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:22.047552 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2vwjz"] Jul 07 13:51:22.047710 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:22.047661 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:22.047763 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:22.047749 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:51:23.728078 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:23.727988 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:23.728505 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:23.728111 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:23.728505 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:23.728131 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:51:23.728505 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:23.728167 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:51:23.728505 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:23.728218 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:23.728505 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:23.728312 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:51:23.867542 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:23.867507 2560 generic.go:356] "Generic (PLEG): container finished" podID="fe34b77f-15e4-43b5-a924-8fa943ca811e" containerID="334414412d387c7085228b6856f15fd14e848e3debd6a8d30f7c9f88652d916a" exitCode=0 Jul 07 13:51:23.867724 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:23.867593 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqzcq" event={"ID":"fe34b77f-15e4-43b5-a924-8fa943ca811e","Type":"ContainerDied","Data":"334414412d387c7085228b6856f15fd14e848e3debd6a8d30f7c9f88652d916a"} Jul 07 13:51:24.871335 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:24.871163 2560 generic.go:356] "Generic (PLEG): container finished" podID="fe34b77f-15e4-43b5-a924-8fa943ca811e" containerID="a93c3ec8b846381d964a7603dfa8113a498c14ba0cba140245a742a7a1fd9aa8" exitCode=0 Jul 07 13:51:24.871816 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:24.871241 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqzcq" event={"ID":"fe34b77f-15e4-43b5-a924-8fa943ca811e","Type":"ContainerDied","Data":"a93c3ec8b846381d964a7603dfa8113a498c14ba0cba140245a742a7a1fd9aa8"} Jul 07 13:51:25.727410 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:25.727382 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:25.727575 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:25.727382 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:25.727575 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:25.727493 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:51:25.727575 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:25.727558 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:51:25.727677 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:25.727382 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:25.727677 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:25.727631 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:51:25.875900 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:25.875794 2560 generic.go:356] "Generic (PLEG): container finished" podID="fe34b77f-15e4-43b5-a924-8fa943ca811e" containerID="43f539a0590510f3232d93173a98d2f7338fdeec676f2cf45b1235d7860601c9" exitCode=0 Jul 07 13:51:25.875900 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:25.875871 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqzcq" event={"ID":"fe34b77f-15e4-43b5-a924-8fa943ca811e","Type":"ContainerDied","Data":"43f539a0590510f3232d93173a98d2f7338fdeec676f2cf45b1235d7860601c9"} Jul 07 13:51:27.304328 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:27.304294 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret\") pod \"global-pull-secret-syncer-rwmks\" (UID: \"3c340622-81e7-4b51-806b-0aea3eb6394a\") " pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:27.304815 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:27.304489 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:51:27.304815 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:27.304554 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret podName:3c340622-81e7-4b51-806b-0aea3eb6394a nodeName:}" failed. No retries permitted until 2026-07-07 13:51:59.304534688 +0000 UTC m=+66.169739143 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret") pod "global-pull-secret-syncer-rwmks" (UID: "3c340622-81e7-4b51-806b-0aea3eb6394a") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:51:27.405546 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:27.405513 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs\") pod \"network-metrics-daemon-jvz97\" (UID: \"25b6321b-a8db-4404-8e21-36dffa3f4585\") " pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:27.405740 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:27.405701 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:51:27.405863 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:27.405788 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs podName:25b6321b-a8db-4404-8e21-36dffa3f4585 nodeName:}" failed. No retries permitted until 2026-07-07 13:51:59.405768112 +0000 UTC m=+66.270972567 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs") pod "network-metrics-daemon-jvz97" (UID: "25b6321b-a8db-4404-8e21-36dffa3f4585") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:51:27.506880 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:27.506844 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv4l6\" (UniqueName: \"kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6\") pod \"network-check-target-2vwjz\" (UID: \"8dbec015-6c0e-4468-a867-d8cb583b8f6f\") " pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:27.507065 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:27.507043 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:51:27.507131 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:27.507069 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:51:27.507131 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:27.507084 2560 projected.go:196] Error preparing data for projected volume kube-api-access-fv4l6 for pod openshift-network-diagnostics/network-check-target-2vwjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:51:27.507218 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:27.507148 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6 podName:8dbec015-6c0e-4468-a867-d8cb583b8f6f nodeName:}" failed. No retries permitted until 2026-07-07 13:51:59.507129603 +0000 UTC m=+66.372334050 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fv4l6" (UniqueName: "kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6") pod "network-check-target-2vwjz" (UID: "8dbec015-6c0e-4468-a867-d8cb583b8f6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:51:27.728025 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:27.727939 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:27.728172 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:27.727939 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:27.728172 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:27.728082 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwmks" podUID="3c340622-81e7-4b51-806b-0aea3eb6394a" Jul 07 13:51:27.728172 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:27.727936 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:27.728304 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:27.728169 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvz97" podUID="25b6321b-a8db-4404-8e21-36dffa3f4585" Jul 07 13:51:27.728304 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:27.728228 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2vwjz" podUID="8dbec015-6c0e-4468-a867-d8cb583b8f6f" Jul 07 13:51:27.950672 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:27.950641 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-38.ec2.internal" event="NodeReady" Jul 07 13:51:27.950915 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:27.950768 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 13:51:27.996759 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:27.996681 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5wh59"] Jul 07 13:51:27.998721 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:27.998679 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:27.999564 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:27.999543 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r7hj6"] Jul 07 13:51:28.001339 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.001319 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r7hj6" Jul 07 13:51:28.001339 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.001331 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wzwpw\"" Jul 07 13:51:28.001492 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.001371 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 13:51:28.001492 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.001457 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 13:51:28.003813 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.003596 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 13:51:28.003813 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.003640 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 13:51:28.003813 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.003667 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b8kcb\"" Jul 07 13:51:28.003813 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.003743 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 13:51:28.010056 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.010026 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5wh59"] Jul 07 13:51:28.013351 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.013332 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r7hj6"] Jul 07 13:51:28.110702 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.110667 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52b308d7-d010-494b-95d4-76f812b474b0-tmp-dir\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:28.110702 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.110702 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h67cx\" (UniqueName: \"kubernetes.io/projected/e388ff14-7f6e-4166-ade2-4d895ed00f2c-kube-api-access-h67cx\") pod \"ingress-canary-r7hj6\" (UID: \"e388ff14-7f6e-4166-ade2-4d895ed00f2c\") " pod="openshift-ingress-canary/ingress-canary-r7hj6" Jul 07 13:51:28.110958 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.110733 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52b308d7-d010-494b-95d4-76f812b474b0-config-volume\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:28.110958 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.110791 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln7sx\" (UniqueName: \"kubernetes.io/projected/52b308d7-d010-494b-95d4-76f812b474b0-kube-api-access-ln7sx\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:28.110958 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.110861 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:28.110958 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.110905 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e388ff14-7f6e-4166-ade2-4d895ed00f2c-cert\") pod \"ingress-canary-r7hj6\" (UID: \"e388ff14-7f6e-4166-ade2-4d895ed00f2c\") " pod="openshift-ingress-canary/ingress-canary-r7hj6" Jul 07 13:51:28.211569 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.211534 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h67cx\" (UniqueName: \"kubernetes.io/projected/e388ff14-7f6e-4166-ade2-4d895ed00f2c-kube-api-access-h67cx\") pod \"ingress-canary-r7hj6\" (UID: \"e388ff14-7f6e-4166-ade2-4d895ed00f2c\") " pod="openshift-ingress-canary/ingress-canary-r7hj6" Jul 07 13:51:28.211729 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.211583 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52b308d7-d010-494b-95d4-76f812b474b0-config-volume\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:28.211729 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.211605 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln7sx\" (UniqueName: \"kubernetes.io/projected/52b308d7-d010-494b-95d4-76f812b474b0-kube-api-access-ln7sx\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:28.211816 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.211735 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:28.211816 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.211770 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e388ff14-7f6e-4166-ade2-4d895ed00f2c-cert\") pod \"ingress-canary-r7hj6\" (UID: \"e388ff14-7f6e-4166-ade2-4d895ed00f2c\") " pod="openshift-ingress-canary/ingress-canary-r7hj6" Jul 07 13:51:28.211816 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.211803 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52b308d7-d010-494b-95d4-76f812b474b0-tmp-dir\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:28.211979 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:28.211894 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:51:28.211979 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:28.211954 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls podName:52b308d7-d010-494b-95d4-76f812b474b0 nodeName:}" failed. No retries permitted until 2026-07-07 13:51:28.711934829 +0000 UTC m=+35.577139274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls") pod "dns-default-5wh59" (UID: "52b308d7-d010-494b-95d4-76f812b474b0") : secret "dns-default-metrics-tls" not found Jul 07 13:51:28.212106 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.212088 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52b308d7-d010-494b-95d4-76f812b474b0-tmp-dir\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:28.212161 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.212144 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52b308d7-d010-494b-95d4-76f812b474b0-config-volume\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:28.215634 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.215616 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e388ff14-7f6e-4166-ade2-4d895ed00f2c-cert\") pod \"ingress-canary-r7hj6\" (UID: \"e388ff14-7f6e-4166-ade2-4d895ed00f2c\") " pod="openshift-ingress-canary/ingress-canary-r7hj6" Jul 07 13:51:28.219840 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.219806 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln7sx\" (UniqueName: \"kubernetes.io/projected/52b308d7-d010-494b-95d4-76f812b474b0-kube-api-access-ln7sx\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:28.220289 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.220268 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h67cx\" (UniqueName: \"kubernetes.io/projected/e388ff14-7f6e-4166-ade2-4d895ed00f2c-kube-api-access-h67cx\") pod \"ingress-canary-r7hj6\" (UID: \"e388ff14-7f6e-4166-ade2-4d895ed00f2c\") " pod="openshift-ingress-canary/ingress-canary-r7hj6" Jul 07 13:51:28.318084 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.318041 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r7hj6" Jul 07 13:51:28.451536 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.451277 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r7hj6"] Jul 07 13:51:28.455523 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:51:28.455492 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode388ff14_7f6e_4166_ade2_4d895ed00f2c.slice/crio-c1edd7f9c53daa2c89079799a51f8f4c1ab969bb9ec6dadf1da8ce3e969b1f4c WatchSource:0}: Error finding container c1edd7f9c53daa2c89079799a51f8f4c1ab969bb9ec6dadf1da8ce3e969b1f4c: Status 404 returned error can't find the container with id c1edd7f9c53daa2c89079799a51f8f4c1ab969bb9ec6dadf1da8ce3e969b1f4c Jul 07 13:51:28.715840 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.715703 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:28.716004 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:28.715875 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:51:28.716004 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:28.715940 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls podName:52b308d7-d010-494b-95d4-76f812b474b0 nodeName:}" failed. No retries permitted until 2026-07-07 13:51:29.715920852 +0000 UTC m=+36.581125307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls") pod "dns-default-5wh59" (UID: "52b308d7-d010-494b-95d4-76f812b474b0") : secret "dns-default-metrics-tls" not found Jul 07 13:51:28.884687 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:28.884586 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r7hj6" event={"ID":"e388ff14-7f6e-4166-ade2-4d895ed00f2c","Type":"ContainerStarted","Data":"c1edd7f9c53daa2c89079799a51f8f4c1ab969bb9ec6dadf1da8ce3e969b1f4c"} Jul 07 13:51:29.724193 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:29.724151 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:29.724712 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:29.724292 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:51:29.724712 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:29.724382 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls podName:52b308d7-d010-494b-95d4-76f812b474b0 nodeName:}" failed. No retries permitted until 2026-07-07 13:51:31.724362238 +0000 UTC m=+38.589566685 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls") pod "dns-default-5wh59" (UID: "52b308d7-d010-494b-95d4-76f812b474b0") : secret "dns-default-metrics-tls" not found Jul 07 13:51:29.727151 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:29.727126 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:29.727284 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:29.727164 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:29.727284 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:29.727136 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:29.730463 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:29.730435 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kxhlm\"" Jul 07 13:51:29.731458 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:29.731256 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 13:51:29.731458 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:29.731270 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xl4wk\"" Jul 07 13:51:29.731458 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:29.731260 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 13:51:29.731458 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:29.731256 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 13:51:29.731458 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:29.731363 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 13:51:31.740518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:31.740491 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:31.740912 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:31.740631 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:51:31.740912 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:31.740701 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls podName:52b308d7-d010-494b-95d4-76f812b474b0 nodeName:}" failed. No retries permitted until 2026-07-07 13:51:35.740683185 +0000 UTC m=+42.605887631 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls") pod "dns-default-5wh59" (UID: "52b308d7-d010-494b-95d4-76f812b474b0") : secret "dns-default-metrics-tls" not found Jul 07 13:51:31.896054 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:31.896022 2560 generic.go:356] "Generic (PLEG): container finished" podID="fe34b77f-15e4-43b5-a924-8fa943ca811e" containerID="0430153ca6f058ee48d8a8c30961144f18e1705c798c73ff4eb3b89b198764ab" exitCode=0 Jul 07 13:51:31.896249 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:31.896095 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqzcq" event={"ID":"fe34b77f-15e4-43b5-a924-8fa943ca811e","Type":"ContainerDied","Data":"0430153ca6f058ee48d8a8c30961144f18e1705c798c73ff4eb3b89b198764ab"} Jul 07 13:51:31.897600 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:31.897579 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r7hj6" event={"ID":"e388ff14-7f6e-4166-ade2-4d895ed00f2c","Type":"ContainerStarted","Data":"54de4810a0695f5d1dd0efd72a027cc1825c1b741b159f5d9ba4b1dc2f0c5cb9"} Jul 07 13:51:31.936769 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:31.936574 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r7hj6" podStartSLOduration=1.856245528 podStartE2EDuration="4.936554252s" totalImagesPullingTime="3.080308724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:51:31.935899297 +0000 UTC m=+38.801103772" watchObservedRunningTime="2026-07-07 13:51:31.936554252 +0000 UTC m=+38.801758718" Jul 07 13:51:32.902271 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:32.902239 2560 generic.go:356] "Generic (PLEG): container finished" podID="fe34b77f-15e4-43b5-a924-8fa943ca811e" containerID="28fbe10ab9301af4ea1cc2cde1f155d11d0fdeb6ba18dfd9962ced838045c110" exitCode=0 Jul 07 13:51:32.902922 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:32.902329 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqzcq" event={"ID":"fe34b77f-15e4-43b5-a924-8fa943ca811e","Type":"ContainerDied","Data":"28fbe10ab9301af4ea1cc2cde1f155d11d0fdeb6ba18dfd9962ced838045c110"} Jul 07 13:51:33.907569 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:33.907535 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqzcq" event={"ID":"fe34b77f-15e4-43b5-a924-8fa943ca811e","Type":"ContainerStarted","Data":"5aeb0762a30608e3525cb1a100fc0c97bab012cd56578c02de20d4e041d4f9a2"} Jul 07 13:51:33.931196 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:33.931142 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xqzcq" podStartSLOduration=8.048241188 podStartE2EDuration="40.931127949s" totalImagesPullingTime="32.882886761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:50:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:51:33.930102645 +0000 UTC m=+40.795307108" watchObservedRunningTime="2026-07-07 13:51:33.931127949 +0000 UTC m=+40.796332412" Jul 07 13:51:35.766288 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:35.766251 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:35.766656 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:35.766363 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:51:35.766656 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:35.766410 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls podName:52b308d7-d010-494b-95d4-76f812b474b0 nodeName:}" failed. No retries permitted until 2026-07-07 13:51:43.766397749 +0000 UTC m=+50.631602191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls") pod "dns-default-5wh59" (UID: "52b308d7-d010-494b-95d4-76f812b474b0") : secret "dns-default-metrics-tls" not found Jul 07 13:51:43.821207 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:43.821162 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:43.821602 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:43.821298 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:51:43.821602 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:43.821369 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls podName:52b308d7-d010-494b-95d4-76f812b474b0 nodeName:}" failed. No retries permitted until 2026-07-07 13:51:59.821352322 +0000 UTC m=+66.686556764 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls") pod "dns-default-5wh59" (UID: "52b308d7-d010-494b-95d4-76f812b474b0") : secret "dns-default-metrics-tls" not found Jul 07 13:51:53.885720 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:53.885687 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8d597" Jul 07 13:51:59.329509 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:59.329474 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret\") pod \"global-pull-secret-syncer-rwmks\" (UID: \"3c340622-81e7-4b51-806b-0aea3eb6394a\") " pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:59.332222 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:59.332205 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 13:51:59.343911 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:59.343887 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c340622-81e7-4b51-806b-0aea3eb6394a-original-pull-secret\") pod \"global-pull-secret-syncer-rwmks\" (UID: \"3c340622-81e7-4b51-806b-0aea3eb6394a\") " pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:59.430326 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:59.430292 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs\") pod \"network-metrics-daemon-jvz97\" (UID: \"25b6321b-a8db-4404-8e21-36dffa3f4585\") " pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:51:59.432714 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:59.432695 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 13:51:59.440708 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:59.440682 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 13:51:59.440781 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:59.440770 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs podName:25b6321b-a8db-4404-8e21-36dffa3f4585 nodeName:}" failed. No retries permitted until 2026-07-07 13:53:03.440750351 +0000 UTC m=+130.305954810 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs") pod "network-metrics-daemon-jvz97" (UID: "25b6321b-a8db-4404-8e21-36dffa3f4585") : secret "metrics-daemon-secret" not found Jul 07 13:51:59.457213 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:59.457171 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwmks" Jul 07 13:51:59.531469 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:59.531442 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv4l6\" (UniqueName: \"kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6\") pod \"network-check-target-2vwjz\" (UID: \"8dbec015-6c0e-4468-a867-d8cb583b8f6f\") " pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:59.534355 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:59.534139 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 13:51:59.544279 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:59.544254 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 13:51:59.554328 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:59.554293 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv4l6\" (UniqueName: \"kubernetes.io/projected/8dbec015-6c0e-4468-a867-d8cb583b8f6f-kube-api-access-fv4l6\") pod \"network-check-target-2vwjz\" (UID: \"8dbec015-6c0e-4468-a867-d8cb583b8f6f\") " pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:59.575417 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:59.575392 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rwmks"] Jul 07 13:51:59.578178 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:51:59.578154 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c340622_81e7_4b51_806b_0aea3eb6394a.slice/crio-3c4f63531333316cbce5341f7333dd208705a7400463b61b2747de9f03dfeab2 WatchSource:0}: Error finding container 3c4f63531333316cbce5341f7333dd208705a7400463b61b2747de9f03dfeab2: Status 404 returned error can't find the container with id 3c4f63531333316cbce5341f7333dd208705a7400463b61b2747de9f03dfeab2 Jul 07 13:51:59.743979 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:59.743952 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kxhlm\"" Jul 07 13:51:59.751644 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:59.751625 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:51:59.832915 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:59.832813 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:51:59.833067 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:59.832948 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:51:59.833067 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:51:59.832998 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls podName:52b308d7-d010-494b-95d4-76f812b474b0 nodeName:}" failed. No retries permitted until 2026-07-07 13:52:31.832984508 +0000 UTC m=+98.698188950 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls") pod "dns-default-5wh59" (UID: "52b308d7-d010-494b-95d4-76f812b474b0") : secret "dns-default-metrics-tls" not found Jul 07 13:51:59.885600 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:59.885571 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2vwjz"] Jul 07 13:51:59.888609 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:51:59.888582 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dbec015_6c0e_4468_a867_d8cb583b8f6f.slice/crio-e1fd0303636e57a379cad31195db89a458f2355e46355d3a40a2b87c634455bd WatchSource:0}: Error finding container e1fd0303636e57a379cad31195db89a458f2355e46355d3a40a2b87c634455bd: Status 404 returned error can't find the container with id e1fd0303636e57a379cad31195db89a458f2355e46355d3a40a2b87c634455bd Jul 07 13:51:59.968400 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:59.968362 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2vwjz" event={"ID":"8dbec015-6c0e-4468-a867-d8cb583b8f6f","Type":"ContainerStarted","Data":"e1fd0303636e57a379cad31195db89a458f2355e46355d3a40a2b87c634455bd"} Jul 07 13:51:59.969356 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:51:59.969328 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rwmks" event={"ID":"3c340622-81e7-4b51-806b-0aea3eb6394a","Type":"ContainerStarted","Data":"3c4f63531333316cbce5341f7333dd208705a7400463b61b2747de9f03dfeab2"} Jul 07 13:52:04.984988 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:04.984883 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2vwjz" event={"ID":"8dbec015-6c0e-4468-a867-d8cb583b8f6f","Type":"ContainerStarted","Data":"f8845a461ec0a1baff9126b61d1edb5759f5de35cd922d8e169dc490271b0a51"} Jul 07 13:52:04.985426 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:04.985017 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:52:04.986204 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:04.986182 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rwmks" event={"ID":"3c340622-81e7-4b51-806b-0aea3eb6394a","Type":"ContainerStarted","Data":"4c7782737e6e9dfa68ae2c1a5fcf0bb903dcd8b5bc03bfec1ebc5fac938d11a2"} Jul 07 13:52:05.000916 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:05.000872 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2vwjz" podStartSLOduration=67.159919591 podStartE2EDuration="1m12.000857578s" totalImagesPullingTime="4.840937987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:52:05.0004269 +0000 UTC m=+71.865631403" watchObservedRunningTime="2026-07-07 13:52:05.000857578 +0000 UTC m=+71.866062060" Jul 07 13:52:05.015057 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:05.015010 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rwmks" podStartSLOduration=66.859584206 podStartE2EDuration="1m12.014997099s" totalImagesPullingTime="5.155412893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:52:05.014787777 +0000 UTC m=+71.879992241" watchObservedRunningTime="2026-07-07 13:52:05.014997099 +0000 UTC m=+71.880201541" Jul 07 13:52:11.455476 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.455436 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m87tt"] Jul 07 13:52:11.457446 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.457423 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m87tt" Jul 07 13:52:11.459629 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.459612 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9zx6c\"" Jul 07 13:52:11.460275 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.460254 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:52:11.460490 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.460275 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 13:52:11.471099 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.471075 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m87tt"] Jul 07 13:52:11.510476 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.510440 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgk6n\" (UniqueName: \"kubernetes.io/projected/2a93fe56-1cb3-41f3-9ae2-fb6377c7889e-kube-api-access-fgk6n\") pod \"volume-data-source-validator-5d456fdbcd-m87tt\" (UID: \"2a93fe56-1cb3-41f3-9ae2-fb6377c7889e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m87tt" Jul 07 13:52:11.568036 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.568004 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jlsz5"] Jul 07 13:52:11.569861 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.569845 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.572170 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.572145 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 13:52:11.572170 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.572165 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 13:52:11.572334 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.572194 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 13:52:11.572334 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.572279 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-z99rw\"" Jul 07 13:52:11.572334 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.572294 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 13:52:11.579758 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.579741 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 13:52:11.584147 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.584127 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jlsz5"] Jul 07 13:52:11.611030 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.610988 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a538900d-f764-4db2-9441-2b5f4338fe03-snapshots\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.611030 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.611033 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a538900d-f764-4db2-9441-2b5f4338fe03-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.611273 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.611075 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgk6n\" (UniqueName: \"kubernetes.io/projected/2a93fe56-1cb3-41f3-9ae2-fb6377c7889e-kube-api-access-fgk6n\") pod \"volume-data-source-validator-5d456fdbcd-m87tt\" (UID: \"2a93fe56-1cb3-41f3-9ae2-fb6377c7889e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m87tt" Jul 07 13:52:11.611273 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.611112 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a538900d-f764-4db2-9441-2b5f4338fe03-serving-cert\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.611273 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.611143 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a538900d-f764-4db2-9441-2b5f4338fe03-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.611273 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.611189 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgpxf\" (UniqueName: \"kubernetes.io/projected/a538900d-f764-4db2-9441-2b5f4338fe03-kube-api-access-pgpxf\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.611273 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.611251 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a538900d-f764-4db2-9441-2b5f4338fe03-tmp\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.619926 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.619896 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgk6n\" (UniqueName: \"kubernetes.io/projected/2a93fe56-1cb3-41f3-9ae2-fb6377c7889e-kube-api-access-fgk6n\") pod \"volume-data-source-validator-5d456fdbcd-m87tt\" (UID: \"2a93fe56-1cb3-41f3-9ae2-fb6377c7889e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m87tt" Jul 07 13:52:11.712007 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.711926 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgpxf\" (UniqueName: \"kubernetes.io/projected/a538900d-f764-4db2-9441-2b5f4338fe03-kube-api-access-pgpxf\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.712007 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.711987 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a538900d-f764-4db2-9441-2b5f4338fe03-tmp\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.712007 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.712009 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a538900d-f764-4db2-9441-2b5f4338fe03-snapshots\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.712251 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.712028 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a538900d-f764-4db2-9441-2b5f4338fe03-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.712251 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.712050 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a538900d-f764-4db2-9441-2b5f4338fe03-serving-cert\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.712251 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.712066 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a538900d-f764-4db2-9441-2b5f4338fe03-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.712593 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.712560 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a538900d-f764-4db2-9441-2b5f4338fe03-tmp\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.712689 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.712633 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a538900d-f764-4db2-9441-2b5f4338fe03-snapshots\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.712770 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.712752 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a538900d-f764-4db2-9441-2b5f4338fe03-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.713344 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.713329 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a538900d-f764-4db2-9441-2b5f4338fe03-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.714430 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.714414 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a538900d-f764-4db2-9441-2b5f4338fe03-serving-cert\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.720555 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.720532 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgpxf\" (UniqueName: \"kubernetes.io/projected/a538900d-f764-4db2-9441-2b5f4338fe03-kube-api-access-pgpxf\") pod \"insights-operator-5c847dcfc4-jlsz5\" (UID: \"a538900d-f764-4db2-9441-2b5f4338fe03\") " pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.765544 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.765510 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m87tt" Jul 07 13:52:11.879131 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.879104 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" Jul 07 13:52:11.882544 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.882512 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m87tt"] Jul 07 13:52:11.886032 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:52:11.886007 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a93fe56_1cb3_41f3_9ae2_fb6377c7889e.slice/crio-ae153b14c1888ed05825d27ddcd8c707418212c5db9bfdddfb01c87e8843f678 WatchSource:0}: Error finding container ae153b14c1888ed05825d27ddcd8c707418212c5db9bfdddfb01c87e8843f678: Status 404 returned error can't find the container with id ae153b14c1888ed05825d27ddcd8c707418212c5db9bfdddfb01c87e8843f678 Jul 07 13:52:11.997441 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:11.997368 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jlsz5"] Jul 07 13:52:12.000396 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:52:12.000371 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda538900d_f764_4db2_9441_2b5f4338fe03.slice/crio-706380a0cf86911b468fbf0838a550af9f80a9f645862e102af83f26244a0d8b WatchSource:0}: Error finding container 706380a0cf86911b468fbf0838a550af9f80a9f645862e102af83f26244a0d8b: Status 404 returned error can't find the container with id 706380a0cf86911b468fbf0838a550af9f80a9f645862e102af83f26244a0d8b Jul 07 13:52:12.002871 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.002783 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m87tt" event={"ID":"2a93fe56-1cb3-41f3-9ae2-fb6377c7889e","Type":"ContainerStarted","Data":"ae153b14c1888ed05825d27ddcd8c707418212c5db9bfdddfb01c87e8843f678"} Jul 07 13:52:12.460758 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.460723 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2"] Jul 07 13:52:12.463369 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.463347 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2" Jul 07 13:52:12.465515 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.465488 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 07 13:52:12.465643 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.465541 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:52:12.465643 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.465563 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-l7bz7\"" Jul 07 13:52:12.465643 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.465598 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 07 13:52:12.466021 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.466005 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 07 13:52:12.474181 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.474163 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2"] Jul 07 13:52:12.516257 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.516223 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ht46\" (UniqueName: \"kubernetes.io/projected/456fa7a4-c5ab-49c3-aff7-1635fd2c5c35-kube-api-access-5ht46\") pod \"service-ca-operator-5d46d9ffd4-8h6h2\" (UID: \"456fa7a4-c5ab-49c3-aff7-1635fd2c5c35\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2" Jul 07 13:52:12.516443 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.516302 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/456fa7a4-c5ab-49c3-aff7-1635fd2c5c35-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-8h6h2\" (UID: \"456fa7a4-c5ab-49c3-aff7-1635fd2c5c35\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2" Jul 07 13:52:12.516443 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.516347 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/456fa7a4-c5ab-49c3-aff7-1635fd2c5c35-config\") pod \"service-ca-operator-5d46d9ffd4-8h6h2\" (UID: \"456fa7a4-c5ab-49c3-aff7-1635fd2c5c35\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2" Jul 07 13:52:12.617678 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.617640 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/456fa7a4-c5ab-49c3-aff7-1635fd2c5c35-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-8h6h2\" (UID: \"456fa7a4-c5ab-49c3-aff7-1635fd2c5c35\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2" Jul 07 13:52:12.617892 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.617707 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/456fa7a4-c5ab-49c3-aff7-1635fd2c5c35-config\") pod \"service-ca-operator-5d46d9ffd4-8h6h2\" (UID: \"456fa7a4-c5ab-49c3-aff7-1635fd2c5c35\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2" Jul 07 13:52:12.617892 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.617763 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ht46\" (UniqueName: \"kubernetes.io/projected/456fa7a4-c5ab-49c3-aff7-1635fd2c5c35-kube-api-access-5ht46\") pod \"service-ca-operator-5d46d9ffd4-8h6h2\" (UID: \"456fa7a4-c5ab-49c3-aff7-1635fd2c5c35\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2" Jul 07 13:52:12.618390 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.618360 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/456fa7a4-c5ab-49c3-aff7-1635fd2c5c35-config\") pod \"service-ca-operator-5d46d9ffd4-8h6h2\" (UID: \"456fa7a4-c5ab-49c3-aff7-1635fd2c5c35\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2" Jul 07 13:52:12.619995 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.619973 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/456fa7a4-c5ab-49c3-aff7-1635fd2c5c35-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-8h6h2\" (UID: \"456fa7a4-c5ab-49c3-aff7-1635fd2c5c35\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2" Jul 07 13:52:12.626008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.625986 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ht46\" (UniqueName: \"kubernetes.io/projected/456fa7a4-c5ab-49c3-aff7-1635fd2c5c35-kube-api-access-5ht46\") pod \"service-ca-operator-5d46d9ffd4-8h6h2\" (UID: \"456fa7a4-c5ab-49c3-aff7-1635fd2c5c35\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2" Jul 07 13:52:12.771914 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.771809 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2" Jul 07 13:52:12.921284 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:12.921172 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2"] Jul 07 13:52:12.926219 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:52:12.926189 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod456fa7a4_c5ab_49c3_aff7_1635fd2c5c35.slice/crio-533faa925c45ceb5778ae7d84f56393b7c7224e97d2163aace7e00f58a9f904a WatchSource:0}: Error finding container 533faa925c45ceb5778ae7d84f56393b7c7224e97d2163aace7e00f58a9f904a: Status 404 returned error can't find the container with id 533faa925c45ceb5778ae7d84f56393b7c7224e97d2163aace7e00f58a9f904a Jul 07 13:52:13.007667 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:13.007630 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" event={"ID":"a538900d-f764-4db2-9441-2b5f4338fe03","Type":"ContainerStarted","Data":"706380a0cf86911b468fbf0838a550af9f80a9f645862e102af83f26244a0d8b"} Jul 07 13:52:13.008923 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:13.008894 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2" event={"ID":"456fa7a4-c5ab-49c3-aff7-1635fd2c5c35","Type":"ContainerStarted","Data":"533faa925c45ceb5778ae7d84f56393b7c7224e97d2163aace7e00f58a9f904a"} Jul 07 13:52:14.014934 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:14.014888 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m87tt" event={"ID":"2a93fe56-1cb3-41f3-9ae2-fb6377c7889e","Type":"ContainerStarted","Data":"bb221cc00d636451c653a28ee3f294e077574294598fdd916b7c765c9e0544ce"} Jul 07 13:52:14.016560 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:14.016525 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" event={"ID":"a538900d-f764-4db2-9441-2b5f4338fe03","Type":"ContainerStarted","Data":"a4cd30274fcd9eef1bc509ad96973d7c9453ce5a4bd47e99feee7f762161b5bf"} Jul 07 13:52:14.033685 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:14.033526 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m87tt" podStartSLOduration=1.6855004390000001 podStartE2EDuration="3.033509831s" totalImagesPullingTime="1.348009392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:52:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:52:14.033472299 +0000 UTC m=+80.898676760" watchObservedRunningTime="2026-07-07 13:52:14.033509831 +0000 UTC m=+80.898714295" Jul 07 13:52:14.054601 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:14.054553 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" podStartSLOduration=1.28706983 podStartE2EDuration="3.054535336s" totalImagesPullingTime="1.767465506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:52:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:52:14.054309941 +0000 UTC m=+80.919514406" watchObservedRunningTime="2026-07-07 13:52:14.054535336 +0000 UTC m=+80.919739790" Jul 07 13:52:15.158797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.158557 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zczhm"] Jul 07 13:52:15.161940 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.161914 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:15.164220 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.164061 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 13:52:15.164220 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.164126 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 13:52:15.164220 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.164207 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fqk4l\"" Jul 07 13:52:15.174957 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.174930 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zczhm"] Jul 07 13:52:15.236449 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.236413 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5e5343e-8c1b-4645-b20e-d26164fded60-data-volume\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:15.236636 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.236457 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5e5343e-8c1b-4645-b20e-d26164fded60-crio-socket\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:15.236636 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.236487 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trnw7\" (UniqueName: \"kubernetes.io/projected/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-api-access-trnw7\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:15.236636 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.236511 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:15.236636 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.236599 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:15.337155 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.337118 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:15.337345 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.337182 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5e5343e-8c1b-4645-b20e-d26164fded60-data-volume\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:15.337345 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.337213 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5e5343e-8c1b-4645-b20e-d26164fded60-crio-socket\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:15.337345 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.337231 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trnw7\" (UniqueName: \"kubernetes.io/projected/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-api-access-trnw7\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:15.337345 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:15.337237 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 13:52:15.337345 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.337263 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:15.337345 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:15.337321 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm podName:e5e5343e-8c1b-4645-b20e-d26164fded60 nodeName:}" failed. No retries permitted until 2026-07-07 13:52:15.837294291 +0000 UTC m=+82.702498733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zczhm" (UID: "e5e5343e-8c1b-4645-b20e-d26164fded60") : configmap "kube-rbac-proxy" not found Jul 07 13:52:15.337777 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.337354 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5e5343e-8c1b-4645-b20e-d26164fded60-crio-socket\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:15.337777 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:15.337364 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 13:52:15.337777 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:15.337444 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls podName:e5e5343e-8c1b-4645-b20e-d26164fded60 nodeName:}" failed. No retries permitted until 2026-07-07 13:52:15.837426298 +0000 UTC m=+82.702630743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zczhm" (UID: "e5e5343e-8c1b-4645-b20e-d26164fded60") : secret "insights-runtime-extractor-tls" not found Jul 07 13:52:15.337777 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.337507 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5e5343e-8c1b-4645-b20e-d26164fded60-data-volume\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:15.348367 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.348341 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trnw7\" (UniqueName: \"kubernetes.io/projected/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-api-access-trnw7\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:15.841004 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.840973 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:15.841183 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:15.841033 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:15.841183 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:15.841100 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 13:52:15.841183 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:15.841131 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 13:52:15.841183 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:15.841166 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm podName:e5e5343e-8c1b-4645-b20e-d26164fded60 nodeName:}" failed. No retries permitted until 2026-07-07 13:52:16.841147528 +0000 UTC m=+83.706351970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zczhm" (UID: "e5e5343e-8c1b-4645-b20e-d26164fded60") : configmap "kube-rbac-proxy" not found Jul 07 13:52:15.841183 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:15.841181 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls podName:e5e5343e-8c1b-4645-b20e-d26164fded60 nodeName:}" failed. No retries permitted until 2026-07-07 13:52:16.841175791 +0000 UTC m=+83.706380233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zczhm" (UID: "e5e5343e-8c1b-4645-b20e-d26164fded60") : secret "insights-runtime-extractor-tls" not found Jul 07 13:52:16.024642 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:16.024604 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2" event={"ID":"456fa7a4-c5ab-49c3-aff7-1635fd2c5c35","Type":"ContainerStarted","Data":"68457339bc42eadbabaac9b8d1e9ff1c9b47183d5f1a6031614e7f30ed05b914"} Jul 07 13:52:16.042356 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:16.042304 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2" podStartSLOduration=1.5864615039999999 podStartE2EDuration="4.042286724s" totalImagesPullingTime="2.45582522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:52:16.041491386 +0000 UTC m=+82.906695851" watchObservedRunningTime="2026-07-07 13:52:16.042286724 +0000 UTC m=+82.907491216" Jul 07 13:52:16.849649 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:16.849606 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:16.850082 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:16.849671 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:16.850082 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:16.849726 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 13:52:16.850082 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:16.849785 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 13:52:16.850082 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:16.849792 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm podName:e5e5343e-8c1b-4645-b20e-d26164fded60 nodeName:}" failed. No retries permitted until 2026-07-07 13:52:18.84977428 +0000 UTC m=+85.714978736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zczhm" (UID: "e5e5343e-8c1b-4645-b20e-d26164fded60") : configmap "kube-rbac-proxy" not found Jul 07 13:52:16.850082 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:16.849896 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls podName:e5e5343e-8c1b-4645-b20e-d26164fded60 nodeName:}" failed. No retries permitted until 2026-07-07 13:52:18.849884911 +0000 UTC m=+85.715089354 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zczhm" (UID: "e5e5343e-8c1b-4645-b20e-d26164fded60") : secret "insights-runtime-extractor-tls" not found Jul 07 13:52:17.353275 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:17.353252 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zbsrw_67f25601-a3a1-41ef-80da-a2a319e9e59d/dns-node-resolver/0.log" Jul 07 13:52:17.850068 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:17.850018 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cc4df75c8-lcqsr"] Jul 07 13:52:17.853296 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:17.853271 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:17.855489 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:17.855458 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 13:52:17.855615 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:17.855500 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 13:52:17.855615 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:17.855535 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 13:52:17.855615 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:17.855549 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mrqnl\"" Jul 07 13:52:17.860462 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:17.860444 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 13:52:17.864606 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:17.864585 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cc4df75c8-lcqsr"] Jul 07 13:52:17.956768 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:17.956734 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-trusted-ca\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:17.956768 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:17.956777 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl4cw\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-kube-api-access-cl4cw\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:17.957008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:17.956884 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-bound-sa-token\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:17.957008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:17.956933 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-ca-trust-extracted\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:17.957008 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:17.956970 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-image-registry-private-configuration\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:17.957119 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:17.957079 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-certificates\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:17.957149 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:17.957135 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-installation-pull-secrets\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:17.957180 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:17.957169 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:18.058066 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.058026 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-trusted-ca\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:18.058066 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.058066 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl4cw\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-kube-api-access-cl4cw\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:18.058338 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.058090 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-bound-sa-token\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:18.058338 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.058117 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-ca-trust-extracted\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:18.058338 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.058149 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-image-registry-private-configuration\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:18.058338 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.058226 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-certificates\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:18.058338 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.058271 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-installation-pull-secrets\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:18.058338 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.058311 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:18.058663 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:18.058408 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 13:52:18.058663 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:18.058423 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cc4df75c8-lcqsr: secret "image-registry-tls" not found Jul 07 13:52:18.058663 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:18.058480 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls podName:69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f nodeName:}" failed. No retries permitted until 2026-07-07 13:52:18.558459756 +0000 UTC m=+85.423664199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls") pod "image-registry-cc4df75c8-lcqsr" (UID: "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f") : secret "image-registry-tls" not found Jul 07 13:52:18.058663 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.058583 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-ca-trust-extracted\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:18.058817 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.058786 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-certificates\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:18.059193 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.059172 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-trusted-ca\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:18.060593 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.060574 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-installation-pull-secrets\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:18.060689 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.060628 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-image-registry-private-configuration\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:18.069227 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.069202 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-bound-sa-token\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:18.071083 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.071060 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl4cw\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-kube-api-access-cl4cw\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:18.152351 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.152279 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rdm4s_b3f5fe49-2e39-4720-8e53-ba898c743f46/node-ca/0.log" Jul 07 13:52:18.562128 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.562094 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:18.562292 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:18.562226 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 13:52:18.562292 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:18.562238 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cc4df75c8-lcqsr: secret "image-registry-tls" not found Jul 07 13:52:18.562292 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:18.562287 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls podName:69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f nodeName:}" failed. No retries permitted until 2026-07-07 13:52:19.562272896 +0000 UTC m=+86.427477339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls") pod "image-registry-cc4df75c8-lcqsr" (UID: "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f") : secret "image-registry-tls" not found Jul 07 13:52:18.677489 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.677457 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-hf49m"] Jul 07 13:52:18.679982 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.679961 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-hf49m" Jul 07 13:52:18.682208 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.682188 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 07 13:52:18.682440 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.682409 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pmttc\"" Jul 07 13:52:18.682546 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.682459 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 07 13:52:18.682546 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.682514 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 07 13:52:18.682763 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.682747 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 07 13:52:18.689408 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.689387 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-hf49m"] Jul 07 13:52:18.763547 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.763512 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/760855d0-2000-4ff6-9bb8-ec2d10d9e147-signing-cabundle\") pod \"service-ca-758f599c5-hf49m\" (UID: \"760855d0-2000-4ff6-9bb8-ec2d10d9e147\") " pod="openshift-service-ca/service-ca-758f599c5-hf49m" Jul 07 13:52:18.763547 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.763550 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/760855d0-2000-4ff6-9bb8-ec2d10d9e147-signing-key\") pod \"service-ca-758f599c5-hf49m\" (UID: \"760855d0-2000-4ff6-9bb8-ec2d10d9e147\") " pod="openshift-service-ca/service-ca-758f599c5-hf49m" Jul 07 13:52:18.763775 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.763643 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x6kl\" (UniqueName: \"kubernetes.io/projected/760855d0-2000-4ff6-9bb8-ec2d10d9e147-kube-api-access-6x6kl\") pod \"service-ca-758f599c5-hf49m\" (UID: \"760855d0-2000-4ff6-9bb8-ec2d10d9e147\") " pod="openshift-service-ca/service-ca-758f599c5-hf49m" Jul 07 13:52:18.864199 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.864111 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x6kl\" (UniqueName: \"kubernetes.io/projected/760855d0-2000-4ff6-9bb8-ec2d10d9e147-kube-api-access-6x6kl\") pod \"service-ca-758f599c5-hf49m\" (UID: \"760855d0-2000-4ff6-9bb8-ec2d10d9e147\") " pod="openshift-service-ca/service-ca-758f599c5-hf49m" Jul 07 13:52:18.864199 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.864152 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:18.864199 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.864196 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/760855d0-2000-4ff6-9bb8-ec2d10d9e147-signing-cabundle\") pod \"service-ca-758f599c5-hf49m\" (UID: \"760855d0-2000-4ff6-9bb8-ec2d10d9e147\") " pod="openshift-service-ca/service-ca-758f599c5-hf49m" Jul 07 13:52:18.864635 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:18.864260 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 13:52:18.864635 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:18.864324 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm podName:e5e5343e-8c1b-4645-b20e-d26164fded60 nodeName:}" failed. No retries permitted until 2026-07-07 13:52:22.864304842 +0000 UTC m=+89.729509298 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zczhm" (UID: "e5e5343e-8c1b-4645-b20e-d26164fded60") : configmap "kube-rbac-proxy" not found Jul 07 13:52:18.864635 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.864370 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/760855d0-2000-4ff6-9bb8-ec2d10d9e147-signing-key\") pod \"service-ca-758f599c5-hf49m\" (UID: \"760855d0-2000-4ff6-9bb8-ec2d10d9e147\") " pod="openshift-service-ca/service-ca-758f599c5-hf49m" Jul 07 13:52:18.864635 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.864421 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:18.864635 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:18.864526 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 13:52:18.864635 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:18.864583 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls podName:e5e5343e-8c1b-4645-b20e-d26164fded60 nodeName:}" failed. No retries permitted until 2026-07-07 13:52:22.864568594 +0000 UTC m=+89.729773046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zczhm" (UID: "e5e5343e-8c1b-4645-b20e-d26164fded60") : secret "insights-runtime-extractor-tls" not found Jul 07 13:52:18.864927 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.864909 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/760855d0-2000-4ff6-9bb8-ec2d10d9e147-signing-cabundle\") pod \"service-ca-758f599c5-hf49m\" (UID: \"760855d0-2000-4ff6-9bb8-ec2d10d9e147\") " pod="openshift-service-ca/service-ca-758f599c5-hf49m" Jul 07 13:52:18.866701 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.866685 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/760855d0-2000-4ff6-9bb8-ec2d10d9e147-signing-key\") pod \"service-ca-758f599c5-hf49m\" (UID: \"760855d0-2000-4ff6-9bb8-ec2d10d9e147\") " pod="openshift-service-ca/service-ca-758f599c5-hf49m" Jul 07 13:52:18.871666 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.871647 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x6kl\" (UniqueName: \"kubernetes.io/projected/760855d0-2000-4ff6-9bb8-ec2d10d9e147-kube-api-access-6x6kl\") pod \"service-ca-758f599c5-hf49m\" (UID: \"760855d0-2000-4ff6-9bb8-ec2d10d9e147\") " pod="openshift-service-ca/service-ca-758f599c5-hf49m" Jul 07 13:52:18.952825 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.952798 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r7hj6_e388ff14-7f6e-4166-ade2-4d895ed00f2c/serve-healthcheck-canary/0.log" Jul 07 13:52:18.988774 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:18.988743 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-hf49m" Jul 07 13:52:19.110242 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:19.110212 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-hf49m"] Jul 07 13:52:19.113448 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:52:19.113421 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760855d0_2000_4ff6_9bb8_ec2d10d9e147.slice/crio-7768848e1dccbead77267937fbd1be69969124896727d2f393e71ae53e480b9c WatchSource:0}: Error finding container 7768848e1dccbead77267937fbd1be69969124896727d2f393e71ae53e480b9c: Status 404 returned error can't find the container with id 7768848e1dccbead77267937fbd1be69969124896727d2f393e71ae53e480b9c Jul 07 13:52:19.570726 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:19.570690 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:19.570903 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:19.570863 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 13:52:19.570903 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:19.570881 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cc4df75c8-lcqsr: secret "image-registry-tls" not found Jul 07 13:52:19.570989 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:19.570930 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls podName:69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f nodeName:}" failed. No retries permitted until 2026-07-07 13:52:21.57091594 +0000 UTC m=+88.436120387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls") pod "image-registry-cc4df75c8-lcqsr" (UID: "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f") : secret "image-registry-tls" not found Jul 07 13:52:20.041411 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:20.041329 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-hf49m" event={"ID":"760855d0-2000-4ff6-9bb8-ec2d10d9e147","Type":"ContainerStarted","Data":"679b95245a62f699b8733501dd4a9e075095fb0786fbcbde10a2facbf093b193"} Jul 07 13:52:20.041411 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:20.041379 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-hf49m" event={"ID":"760855d0-2000-4ff6-9bb8-ec2d10d9e147","Type":"ContainerStarted","Data":"7768848e1dccbead77267937fbd1be69969124896727d2f393e71ae53e480b9c"} Jul 07 13:52:20.058423 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:20.058379 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-hf49m" podStartSLOduration=2.058363735 podStartE2EDuration="2.058363735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:52:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:52:20.05739468 +0000 UTC m=+86.922599143" watchObservedRunningTime="2026-07-07 13:52:20.058363735 +0000 UTC m=+86.923568198" Jul 07 13:52:21.589399 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:21.589360 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:21.589864 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:21.589558 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 13:52:21.589864 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:21.589582 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cc4df75c8-lcqsr: secret "image-registry-tls" not found Jul 07 13:52:21.589864 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:21.589654 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls podName:69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f nodeName:}" failed. No retries permitted until 2026-07-07 13:52:25.589633303 +0000 UTC m=+92.454837755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls") pod "image-registry-cc4df75c8-lcqsr" (UID: "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f") : secret "image-registry-tls" not found Jul 07 13:52:22.899249 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:22.899207 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:22.899642 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:22.899272 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:22.899642 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:22.899354 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 13:52:22.899642 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:22.899360 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 13:52:22.899642 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:22.899404 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm podName:e5e5343e-8c1b-4645-b20e-d26164fded60 nodeName:}" failed. No retries permitted until 2026-07-07 13:52:30.899392079 +0000 UTC m=+97.764596521 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zczhm" (UID: "e5e5343e-8c1b-4645-b20e-d26164fded60") : configmap "kube-rbac-proxy" not found Jul 07 13:52:22.899642 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:22.899418 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls podName:e5e5343e-8c1b-4645-b20e-d26164fded60 nodeName:}" failed. No retries permitted until 2026-07-07 13:52:30.899411903 +0000 UTC m=+97.764616345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zczhm" (UID: "e5e5343e-8c1b-4645-b20e-d26164fded60") : secret "insights-runtime-extractor-tls" not found Jul 07 13:52:25.623118 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:25.623072 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:25.625450 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:25.625417 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls\") pod \"image-registry-cc4df75c8-lcqsr\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:25.662689 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:25.662653 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:25.794738 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:25.794614 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cc4df75c8-lcqsr"] Jul 07 13:52:25.797382 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:52:25.797350 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c2dca2_474c_445f_8c6a_bd3f0c8c1e4f.slice/crio-bc49259ede86fbbd759de9f09e88a894ab80f4d71434c046357c2f4d89b488b6 WatchSource:0}: Error finding container bc49259ede86fbbd759de9f09e88a894ab80f4d71434c046357c2f4d89b488b6: Status 404 returned error can't find the container with id bc49259ede86fbbd759de9f09e88a894ab80f4d71434c046357c2f4d89b488b6 Jul 07 13:52:26.062508 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:26.062473 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" event={"ID":"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f","Type":"ContainerStarted","Data":"c698fd229e1827a4751405350b12609e334cf81dcb1a2844df4f28142a49516e"} Jul 07 13:52:26.062657 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:26.062530 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" event={"ID":"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f","Type":"ContainerStarted","Data":"bc49259ede86fbbd759de9f09e88a894ab80f4d71434c046357c2f4d89b488b6"} Jul 07 13:52:26.062657 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:26.062598 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:26.081468 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:26.081418 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" podStartSLOduration=9.081403264 podStartE2EDuration="9.081403264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:52:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:52:26.08061137 +0000 UTC m=+92.945815836" watchObservedRunningTime="2026-07-07 13:52:26.081403264 +0000 UTC m=+92.946607727" Jul 07 13:52:30.969911 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:30.969878 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:30.970265 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:30.969937 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:30.970409 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:30.970390 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5e5343e-8c1b-4645-b20e-d26164fded60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:30.972224 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:30.972199 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5e5343e-8c1b-4645-b20e-d26164fded60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zczhm\" (UID: \"e5e5343e-8c1b-4645-b20e-d26164fded60\") " pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:31.071806 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:31.071775 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zczhm" Jul 07 13:52:31.210291 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:31.210262 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zczhm"] Jul 07 13:52:31.213253 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:52:31.213222 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e5343e_8c1b_4645_b20e_d26164fded60.slice/crio-326b26782b7e0ed8a1d88e118d9f4cce8d7a0c7d437d53a7d803d436bcfc63f1 WatchSource:0}: Error finding container 326b26782b7e0ed8a1d88e118d9f4cce8d7a0c7d437d53a7d803d436bcfc63f1: Status 404 returned error can't find the container with id 326b26782b7e0ed8a1d88e118d9f4cce8d7a0c7d437d53a7d803d436bcfc63f1 Jul 07 13:52:31.878059 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:31.876990 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:52:31.880131 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:31.880078 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52b308d7-d010-494b-95d4-76f812b474b0-metrics-tls\") pod \"dns-default-5wh59\" (UID: \"52b308d7-d010-494b-95d4-76f812b474b0\") " pod="openshift-dns/dns-default-5wh59" Jul 07 13:52:31.913936 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:31.913903 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wzwpw\"" Jul 07 13:52:31.922543 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:31.922234 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5wh59" Jul 07 13:52:32.084333 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:32.084233 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zczhm" event={"ID":"e5e5343e-8c1b-4645-b20e-d26164fded60","Type":"ContainerStarted","Data":"326b26782b7e0ed8a1d88e118d9f4cce8d7a0c7d437d53a7d803d436bcfc63f1"} Jul 07 13:52:32.087780 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:32.086559 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5wh59"] Jul 07 13:52:32.092074 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:52:32.092043 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b308d7_d010_494b_95d4_76f812b474b0.slice/crio-62ff144f473b97760a8d7368148c83781191ec7293e52a5117634344ec6da892 WatchSource:0}: Error finding container 62ff144f473b97760a8d7368148c83781191ec7293e52a5117634344ec6da892: Status 404 returned error can't find the container with id 62ff144f473b97760a8d7368148c83781191ec7293e52a5117634344ec6da892 Jul 07 13:52:33.089583 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:33.089541 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5wh59" event={"ID":"52b308d7-d010-494b-95d4-76f812b474b0","Type":"ContainerStarted","Data":"62ff144f473b97760a8d7368148c83781191ec7293e52a5117634344ec6da892"} Jul 07 13:52:35.991494 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:35.991468 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2vwjz" Jul 07 13:52:36.100135 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:36.100102 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5wh59" event={"ID":"52b308d7-d010-494b-95d4-76f812b474b0","Type":"ContainerStarted","Data":"63e728eb23b23b8553bac41085ac9001765c8fe592c2ea176f63b5075d8bb8d3"} Jul 07 13:52:36.100365 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:36.100165 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5wh59" Jul 07 13:52:36.100365 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:36.100186 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5wh59" event={"ID":"52b308d7-d010-494b-95d4-76f812b474b0","Type":"ContainerStarted","Data":"df8dd0de2e7a854dc512753fe5818871dff476a7c29a73894ab2ad8664af23bb"} Jul 07 13:52:36.101439 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:36.101417 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zczhm" event={"ID":"e5e5343e-8c1b-4645-b20e-d26164fded60","Type":"ContainerStarted","Data":"1dd1f6261c5ea5aeb3cd79d1105ed95a9e98f4561d185d251cfce711083741a2"} Jul 07 13:52:36.117902 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:36.117837 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5wh59" podStartSLOduration=65.532940863 podStartE2EDuration="1m9.117808722s" totalImagesPullingTime="3.584867859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:52:36.117020158 +0000 UTC m=+102.982224642" watchObservedRunningTime="2026-07-07 13:52:36.117808722 +0000 UTC m=+102.983013188" Jul 07 13:52:38.114159 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:38.114121 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zczhm" event={"ID":"e5e5343e-8c1b-4645-b20e-d26164fded60","Type":"ContainerStarted","Data":"df3d0b866a12673d0f9a6c9bc65a4908a3efa4d50f781ca97511e8fb67b8c2ad"} Jul 07 13:52:40.122697 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:40.122667 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zczhm" event={"ID":"e5e5343e-8c1b-4645-b20e-d26164fded60","Type":"ContainerStarted","Data":"8894de51482ca828b7d3ecae1237dbd260ec559c8ac33f5f3630f536126bddca"} Jul 07 13:52:40.145927 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:40.145817 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zczhm" podStartSLOduration=16.692571114 podStartE2EDuration="25.145803037s" totalImagesPullingTime="8.453231923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:52:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:52:40.144589532 +0000 UTC m=+107.009794010" watchObservedRunningTime="2026-07-07 13:52:40.145803037 +0000 UTC m=+107.011007501" Jul 07 13:52:42.791027 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.790987 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn"] Jul 07 13:52:42.793761 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.793732 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn" Jul 07 13:52:42.796388 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.796372 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 07 13:52:42.797049 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.797031 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 13:52:42.797149 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.797050 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 13:52:42.797149 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.797056 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 13:52:42.810341 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.810313 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn"] Jul 07 13:52:42.875395 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.875364 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cc4df75c8-lcqsr"] Jul 07 13:52:42.879727 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.879699 2560 patch_prober.go:28] interesting pod/image-registry-cc4df75c8-lcqsr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 13:52:42.879885 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.879750 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" podUID="69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 13:52:42.893066 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.893032 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rc5fh"] Jul 07 13:52:42.895357 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.895338 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rc5fh" Jul 07 13:52:42.900033 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.900011 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-r42qb\"" Jul 07 13:52:42.900172 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.900012 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 07 13:52:42.900172 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.900130 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-gskks"] Jul 07 13:52:42.902381 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.902364 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-dlgcz"] Jul 07 13:52:42.902512 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.902494 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-gskks" Jul 07 13:52:42.904359 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.904341 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-dlgcz" Jul 07 13:52:42.904694 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.904677 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 07 13:52:42.905023 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.905009 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-b4rf6\"" Jul 07 13:52:42.905121 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.905108 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 07 13:52:42.907467 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.907453 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 13:52:42.907556 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.907537 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-wxsgg\"" Jul 07 13:52:42.907655 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.907534 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 13:52:42.949445 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.949404 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rc5fh"] Jul 07 13:52:42.950518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.950492 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-gskks"] Jul 07 13:52:42.951331 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.951292 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-dlgcz"] Jul 07 13:52:42.969485 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.969455 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8d2158b1-9d8b-4aea-ba7c-ca19ee527126-klusterlet-config\") pod \"klusterlet-addon-workmgr-79cf99b6d9-98bwn\" (UID: \"8d2158b1-9d8b-4aea-ba7c-ca19ee527126\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn" Jul 07 13:52:42.969655 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.969493 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grlsn\" (UniqueName: \"kubernetes.io/projected/8d2158b1-9d8b-4aea-ba7c-ca19ee527126-kube-api-access-grlsn\") pod \"klusterlet-addon-workmgr-79cf99b6d9-98bwn\" (UID: \"8d2158b1-9d8b-4aea-ba7c-ca19ee527126\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn" Jul 07 13:52:42.969655 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:42.969530 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d2158b1-9d8b-4aea-ba7c-ca19ee527126-tmp\") pod \"klusterlet-addon-workmgr-79cf99b6d9-98bwn\" (UID: \"8d2158b1-9d8b-4aea-ba7c-ca19ee527126\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn" Jul 07 13:52:43.070024 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.069987 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d2158b1-9d8b-4aea-ba7c-ca19ee527126-tmp\") pod \"klusterlet-addon-workmgr-79cf99b6d9-98bwn\" (UID: \"8d2158b1-9d8b-4aea-ba7c-ca19ee527126\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn" Jul 07 13:52:43.070207 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.070040 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8d2158b1-9d8b-4aea-ba7c-ca19ee527126-klusterlet-config\") pod \"klusterlet-addon-workmgr-79cf99b6d9-98bwn\" (UID: \"8d2158b1-9d8b-4aea-ba7c-ca19ee527126\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn" Jul 07 13:52:43.070207 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.070069 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/40f7a9a0-86dc-4c61-8f99-e929a03a602c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-rc5fh\" (UID: \"40f7a9a0-86dc-4c61-8f99-e929a03a602c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rc5fh" Jul 07 13:52:43.070207 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.070089 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grlsn\" (UniqueName: \"kubernetes.io/projected/8d2158b1-9d8b-4aea-ba7c-ca19ee527126-kube-api-access-grlsn\") pod \"klusterlet-addon-workmgr-79cf99b6d9-98bwn\" (UID: \"8d2158b1-9d8b-4aea-ba7c-ca19ee527126\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn" Jul 07 13:52:43.070207 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.070108 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd383f5e-1cbc-42cb-9c9d-61c45f8babd8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-gskks\" (UID: \"bd383f5e-1cbc-42cb-9c9d-61c45f8babd8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-gskks" Jul 07 13:52:43.070207 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.070137 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd383f5e-1cbc-42cb-9c9d-61c45f8babd8-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-gskks\" (UID: \"bd383f5e-1cbc-42cb-9c9d-61c45f8babd8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-gskks" Jul 07 13:52:43.070207 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.070161 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fbbk\" (UniqueName: \"kubernetes.io/projected/63807a3d-4229-4a12-85cf-2be9e56ce961-kube-api-access-2fbbk\") pod \"downloads-685bfb5f64-dlgcz\" (UID: \"63807a3d-4229-4a12-85cf-2be9e56ce961\") " pod="openshift-console/downloads-685bfb5f64-dlgcz" Jul 07 13:52:43.070417 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.070354 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d2158b1-9d8b-4aea-ba7c-ca19ee527126-tmp\") pod \"klusterlet-addon-workmgr-79cf99b6d9-98bwn\" (UID: \"8d2158b1-9d8b-4aea-ba7c-ca19ee527126\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn" Jul 07 13:52:43.072485 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.072463 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8d2158b1-9d8b-4aea-ba7c-ca19ee527126-klusterlet-config\") pod \"klusterlet-addon-workmgr-79cf99b6d9-98bwn\" (UID: \"8d2158b1-9d8b-4aea-ba7c-ca19ee527126\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn" Jul 07 13:52:43.079074 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.079052 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grlsn\" (UniqueName: \"kubernetes.io/projected/8d2158b1-9d8b-4aea-ba7c-ca19ee527126-kube-api-access-grlsn\") pod \"klusterlet-addon-workmgr-79cf99b6d9-98bwn\" (UID: \"8d2158b1-9d8b-4aea-ba7c-ca19ee527126\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn" Jul 07 13:52:43.102719 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.102681 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn" Jul 07 13:52:43.171175 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.170856 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd383f5e-1cbc-42cb-9c9d-61c45f8babd8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-gskks\" (UID: \"bd383f5e-1cbc-42cb-9c9d-61c45f8babd8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-gskks" Jul 07 13:52:43.171175 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.170926 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd383f5e-1cbc-42cb-9c9d-61c45f8babd8-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-gskks\" (UID: \"bd383f5e-1cbc-42cb-9c9d-61c45f8babd8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-gskks" Jul 07 13:52:43.171413 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.171368 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fbbk\" (UniqueName: \"kubernetes.io/projected/63807a3d-4229-4a12-85cf-2be9e56ce961-kube-api-access-2fbbk\") pod \"downloads-685bfb5f64-dlgcz\" (UID: \"63807a3d-4229-4a12-85cf-2be9e56ce961\") " pod="openshift-console/downloads-685bfb5f64-dlgcz" Jul 07 13:52:43.171632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.171533 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/40f7a9a0-86dc-4c61-8f99-e929a03a602c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-rc5fh\" (UID: \"40f7a9a0-86dc-4c61-8f99-e929a03a602c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rc5fh" Jul 07 13:52:43.171713 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.171647 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd383f5e-1cbc-42cb-9c9d-61c45f8babd8-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-gskks\" (UID: \"bd383f5e-1cbc-42cb-9c9d-61c45f8babd8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-gskks" Jul 07 13:52:43.174071 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.174032 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd383f5e-1cbc-42cb-9c9d-61c45f8babd8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-gskks\" (UID: \"bd383f5e-1cbc-42cb-9c9d-61c45f8babd8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-gskks" Jul 07 13:52:43.174386 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.174337 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/40f7a9a0-86dc-4c61-8f99-e929a03a602c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-rc5fh\" (UID: \"40f7a9a0-86dc-4c61-8f99-e929a03a602c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rc5fh" Jul 07 13:52:43.185575 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.185543 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fbbk\" (UniqueName: \"kubernetes.io/projected/63807a3d-4229-4a12-85cf-2be9e56ce961-kube-api-access-2fbbk\") pod \"downloads-685bfb5f64-dlgcz\" (UID: \"63807a3d-4229-4a12-85cf-2be9e56ce961\") " pod="openshift-console/downloads-685bfb5f64-dlgcz" Jul 07 13:52:43.205298 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.205270 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rc5fh" Jul 07 13:52:43.213025 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.212999 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-gskks" Jul 07 13:52:43.218089 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.218056 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-dlgcz" Jul 07 13:52:43.247167 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.247133 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn"] Jul 07 13:52:43.251909 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:52:43.251869 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d2158b1_9d8b_4aea_ba7c_ca19ee527126.slice/crio-8e24d482da1e1eb5ea63721b5da67926091a39b325360255853669f52812368a WatchSource:0}: Error finding container 8e24d482da1e1eb5ea63721b5da67926091a39b325360255853669f52812368a: Status 404 returned error can't find the container with id 8e24d482da1e1eb5ea63721b5da67926091a39b325360255853669f52812368a Jul 07 13:52:43.378671 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.378645 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rc5fh"] Jul 07 13:52:43.380929 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:52:43.380900 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40f7a9a0_86dc_4c61_8f99_e929a03a602c.slice/crio-b66de0810184c4a75fe0e2eb520d6b620a7ccf07c31cf2860e24c0911c937add WatchSource:0}: Error finding container b66de0810184c4a75fe0e2eb520d6b620a7ccf07c31cf2860e24c0911c937add: Status 404 returned error can't find the container with id b66de0810184c4a75fe0e2eb520d6b620a7ccf07c31cf2860e24c0911c937add Jul 07 13:52:43.600643 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.600473 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-gskks"] Jul 07 13:52:43.601999 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.601671 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-dlgcz"] Jul 07 13:52:43.604389 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:52:43.604360 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63807a3d_4229_4a12_85cf_2be9e56ce961.slice/crio-a5779fc1c8bd3d9b68436d67a868044c99f2551440e7325f7b66ae87e7b433a7 WatchSource:0}: Error finding container a5779fc1c8bd3d9b68436d67a868044c99f2551440e7325f7b66ae87e7b433a7: Status 404 returned error can't find the container with id a5779fc1c8bd3d9b68436d67a868044c99f2551440e7325f7b66ae87e7b433a7 Jul 07 13:52:43.604703 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:52:43.604682 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd383f5e_1cbc_42cb_9c9d_61c45f8babd8.slice/crio-8ddaef78c10e9fe056b256b1a792acc1316f337ab3bb0cedc056e88275b9f5b7 WatchSource:0}: Error finding container 8ddaef78c10e9fe056b256b1a792acc1316f337ab3bb0cedc056e88275b9f5b7: Status 404 returned error can't find the container with id 8ddaef78c10e9fe056b256b1a792acc1316f337ab3bb0cedc056e88275b9f5b7 Jul 07 13:52:43.823242 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.823206 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75fc46f75d-lb6v6"] Jul 07 13:52:43.826021 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.825998 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:43.828792 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.828769 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 13:52:43.828946 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.828878 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 13:52:43.829011 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.828946 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-62kcn\"" Jul 07 13:52:43.829137 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.829120 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 13:52:43.829207 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.829124 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 13:52:43.829368 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.829345 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 13:52:43.839888 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.839864 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75fc46f75d-lb6v6"] Jul 07 13:52:43.979779 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.979655 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-console-config\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:43.979779 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.979739 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-service-ca\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:43.980004 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.979814 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/418d998f-1b7d-4a62-8152-c70fa78a6598-console-serving-cert\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:43.980004 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.979912 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-oauth-serving-cert\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:43.980004 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.979940 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8kbs\" (UniqueName: \"kubernetes.io/projected/418d998f-1b7d-4a62-8152-c70fa78a6598-kube-api-access-g8kbs\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:43.980004 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:43.979967 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/418d998f-1b7d-4a62-8152-c70fa78a6598-console-oauth-config\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:44.081129 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.081074 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/418d998f-1b7d-4a62-8152-c70fa78a6598-console-serving-cert\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:44.081287 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.081152 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-oauth-serving-cert\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:44.081287 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.081176 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8kbs\" (UniqueName: \"kubernetes.io/projected/418d998f-1b7d-4a62-8152-c70fa78a6598-kube-api-access-g8kbs\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:44.081287 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.081204 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/418d998f-1b7d-4a62-8152-c70fa78a6598-console-oauth-config\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:44.081287 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.081226 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-console-config\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:44.081287 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.081256 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-service-ca\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:44.082142 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.082035 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-service-ca\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:44.082767 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.082510 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-oauth-serving-cert\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:44.082767 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.082747 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-console-config\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:44.084712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.084691 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/418d998f-1b7d-4a62-8152-c70fa78a6598-console-serving-cert\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:44.084807 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.084695 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/418d998f-1b7d-4a62-8152-c70fa78a6598-console-oauth-config\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:44.090909 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.090882 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8kbs\" (UniqueName: \"kubernetes.io/projected/418d998f-1b7d-4a62-8152-c70fa78a6598-kube-api-access-g8kbs\") pod \"console-75fc46f75d-lb6v6\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:44.137656 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.137592 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn" event={"ID":"8d2158b1-9d8b-4aea-ba7c-ca19ee527126","Type":"ContainerStarted","Data":"8e24d482da1e1eb5ea63721b5da67926091a39b325360255853669f52812368a"} Jul 07 13:52:44.139238 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.139208 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-dlgcz" event={"ID":"63807a3d-4229-4a12-85cf-2be9e56ce961","Type":"ContainerStarted","Data":"a5779fc1c8bd3d9b68436d67a868044c99f2551440e7325f7b66ae87e7b433a7"} Jul 07 13:52:44.139369 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.139301 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:44.140538 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.140490 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-gskks" event={"ID":"bd383f5e-1cbc-42cb-9c9d-61c45f8babd8","Type":"ContainerStarted","Data":"8ddaef78c10e9fe056b256b1a792acc1316f337ab3bb0cedc056e88275b9f5b7"} Jul 07 13:52:44.141998 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.141948 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rc5fh" event={"ID":"40f7a9a0-86dc-4c61-8f99-e929a03a602c","Type":"ContainerStarted","Data":"b66de0810184c4a75fe0e2eb520d6b620a7ccf07c31cf2860e24c0911c937add"} Jul 07 13:52:44.316847 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:44.316801 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75fc46f75d-lb6v6"] Jul 07 13:52:44.320147 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:52:44.320115 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod418d998f_1b7d_4a62_8152_c70fa78a6598.slice/crio-294d1885824cfc7af432b10ad8bfc8f6f0a55ce228c00d2d63c4d3461e5aa12f WatchSource:0}: Error finding container 294d1885824cfc7af432b10ad8bfc8f6f0a55ce228c00d2d63c4d3461e5aa12f: Status 404 returned error can't find the container with id 294d1885824cfc7af432b10ad8bfc8f6f0a55ce228c00d2d63c4d3461e5aa12f Jul 07 13:52:45.148664 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:45.148577 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75fc46f75d-lb6v6" event={"ID":"418d998f-1b7d-4a62-8152-c70fa78a6598","Type":"ContainerStarted","Data":"294d1885824cfc7af432b10ad8bfc8f6f0a55ce228c00d2d63c4d3461e5aa12f"} Jul 07 13:52:46.111905 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:46.111873 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5wh59" Jul 07 13:52:46.156855 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:46.156452 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rc5fh" event={"ID":"40f7a9a0-86dc-4c61-8f99-e929a03a602c","Type":"ContainerStarted","Data":"b3d79f40659271bffaa6b06d0fcedfa593bc50b45c18d6af6c5e77a86cf21e77"} Jul 07 13:52:46.159851 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:46.157645 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rc5fh" Jul 07 13:52:46.164478 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:46.164404 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rc5fh" Jul 07 13:52:46.176003 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:46.174553 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-rc5fh" podStartSLOduration=2.258744606 podStartE2EDuration="4.174531397s" totalImagesPullingTime="1.915786791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:52:46.17394355 +0000 UTC m=+113.039148042" watchObservedRunningTime="2026-07-07 13:52:46.174531397 +0000 UTC m=+113.039735863" Jul 07 13:52:47.164118 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:47.164044 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-gskks" event={"ID":"bd383f5e-1cbc-42cb-9c9d-61c45f8babd8","Type":"ContainerStarted","Data":"be9c494108fc0393451a56a49de2404656c5723f91693578018a5e8dfec2aac2"} Jul 07 13:52:47.187402 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:47.187339 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-gskks" podStartSLOduration=3.496605526 podStartE2EDuration="5.187313547s" totalImagesPullingTime="1.690708021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:52:47.186821396 +0000 UTC m=+114.052025860" watchObservedRunningTime="2026-07-07 13:52:47.187313547 +0000 UTC m=+114.052518012" Jul 07 13:52:50.175907 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.175867 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn" event={"ID":"8d2158b1-9d8b-4aea-ba7c-ca19ee527126","Type":"ContainerStarted","Data":"eef36b79a4bac87fe0b172b76f09b09a8ebf059bcf6181f2b1ed26dc4eea8b5e"} Jul 07 13:52:50.176362 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.175927 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn" Jul 07 13:52:50.177774 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.177738 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75fc46f75d-lb6v6" event={"ID":"418d998f-1b7d-4a62-8152-c70fa78a6598","Type":"ContainerStarted","Data":"5bac7458d8d2ce1041a470582bd7ebd58ecb447b861802730cc2944c144c055f"} Jul 07 13:52:50.178139 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.178113 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn" Jul 07 13:52:50.193961 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.193910 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79cf99b6d9-98bwn" podStartSLOduration=2.175716126 podStartE2EDuration="8.193893243s" totalImagesPullingTime="6.018177117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:52:50.192602331 +0000 UTC m=+117.057806829" watchObservedRunningTime="2026-07-07 13:52:50.193893243 +0000 UTC m=+117.059097706" Jul 07 13:52:50.209467 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.209380 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75fc46f75d-lb6v6" podStartSLOduration=2.268181046 podStartE2EDuration="7.209352393s" totalImagesPullingTime="4.941171347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:52:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:52:50.20917367 +0000 UTC m=+117.074378165" watchObservedRunningTime="2026-07-07 13:52:50.209352393 +0000 UTC m=+117.074556861" Jul 07 13:52:50.732422 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.732385 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4"] Jul 07 13:52:50.735057 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.735041 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:50.739708 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.739681 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 13:52:50.739708 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.739698 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 07 13:52:50.739932 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.739914 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 07 13:52:50.740016 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.739989 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 13:52:50.740155 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.740138 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nfkl5\"" Jul 07 13:52:50.740252 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.740144 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 07 13:52:50.740441 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.740414 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 13:52:50.754108 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.754083 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4"] Jul 07 13:52:50.773261 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.773231 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db"] Jul 07 13:52:50.775956 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.775923 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" Jul 07 13:52:50.779958 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.779489 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 07 13:52:50.779958 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.779723 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tqpn9\"" Jul 07 13:52:50.779958 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.779862 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 07 13:52:50.792768 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.792129 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mzn5f"] Jul 07 13:52:50.794637 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.794613 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db"] Jul 07 13:52:50.794766 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.794751 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:50.799245 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.798861 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 13:52:50.799245 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.798954 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 13:52:50.799245 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.799086 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 13:52:50.799245 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.799120 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dhqsp\"" Jul 07 13:52:50.844717 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.844668 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:50.844962 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.844800 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:50.844962 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.844890 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp54x\" (UniqueName: \"kubernetes.io/projected/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-kube-api-access-lp54x\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:50.844962 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.844922 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:50.845151 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.844974 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:50.845151 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.845007 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:50.946086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.945438 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp54x\" (UniqueName: \"kubernetes.io/projected/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-kube-api-access-lp54x\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:50.946086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.945491 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a61a6530-5474-405e-bf6e-8ffc6301e4f6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-z88db\" (UID: \"a61a6530-5474-405e-bf6e-8ffc6301e4f6\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" Jul 07 13:52:50.946086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.945522 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67v6s\" (UniqueName: \"kubernetes.io/projected/fe906d88-1dae-4b85-a216-e1f9a50ab607-kube-api-access-67v6s\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:50.946086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.945552 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:50.946086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.945579 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a61a6530-5474-405e-bf6e-8ffc6301e4f6-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-z88db\" (UID: \"a61a6530-5474-405e-bf6e-8ffc6301e4f6\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" Jul 07 13:52:50.946086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.945603 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-tls\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:50.946086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.945637 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:50.946086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.945669 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-textfile\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:50.946086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.945698 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:50.946086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.945730 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a61a6530-5474-405e-bf6e-8ffc6301e4f6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-z88db\" (UID: \"a61a6530-5474-405e-bf6e-8ffc6301e4f6\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" Jul 07 13:52:50.946086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.945765 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:50.946086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.945813 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts6wk\" (UniqueName: \"kubernetes.io/projected/a61a6530-5474-405e-bf6e-8ffc6301e4f6-kube-api-access-ts6wk\") pod \"openshift-state-metrics-54cf96dfcf-z88db\" (UID: \"a61a6530-5474-405e-bf6e-8ffc6301e4f6\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" Jul 07 13:52:50.946086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.945851 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-accelerators-collector-config\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:50.946086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.945878 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe906d88-1dae-4b85-a216-e1f9a50ab607-sys\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:50.946086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.946046 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe906d88-1dae-4b85-a216-e1f9a50ab607-root\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:50.946971 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.946078 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe906d88-1dae-4b85-a216-e1f9a50ab607-metrics-client-ca\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:50.946971 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.946109 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-wtmp\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:50.946971 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.946141 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:50.946971 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.946183 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:50.946971 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:50.946313 2560 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 07 13:52:50.946971 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:50.946370 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-kube-state-metrics-tls podName:ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6 nodeName:}" failed. No retries permitted until 2026-07-07 13:52:51.446350913 +0000 UTC m=+118.311555355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-glqq4" (UID: "ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6") : secret "kube-state-metrics-tls" not found Jul 07 13:52:50.946971 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.946399 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:50.946971 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.946492 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:50.946971 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.946682 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:50.965802 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.949406 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:50.965802 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:50.955637 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp54x\" (UniqueName: \"kubernetes.io/projected/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-kube-api-access-lp54x\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:51.046648 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.046615 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe906d88-1dae-4b85-a216-e1f9a50ab607-root\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.047518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.046688 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe906d88-1dae-4b85-a216-e1f9a50ab607-metrics-client-ca\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.047518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.046722 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-wtmp\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.047518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.046740 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe906d88-1dae-4b85-a216-e1f9a50ab607-root\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.047518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.046760 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.047518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.046801 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a61a6530-5474-405e-bf6e-8ffc6301e4f6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-z88db\" (UID: \"a61a6530-5474-405e-bf6e-8ffc6301e4f6\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" Jul 07 13:52:51.047518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.046841 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67v6s\" (UniqueName: \"kubernetes.io/projected/fe906d88-1dae-4b85-a216-e1f9a50ab607-kube-api-access-67v6s\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.047518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.047054 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-wtmp\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.047518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.047155 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a61a6530-5474-405e-bf6e-8ffc6301e4f6-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-z88db\" (UID: \"a61a6530-5474-405e-bf6e-8ffc6301e4f6\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" Jul 07 13:52:51.047518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.047190 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-tls\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.047518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.047244 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-textfile\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.047518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.047302 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a61a6530-5474-405e-bf6e-8ffc6301e4f6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-z88db\" (UID: \"a61a6530-5474-405e-bf6e-8ffc6301e4f6\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" Jul 07 13:52:51.047518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.047346 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts6wk\" (UniqueName: \"kubernetes.io/projected/a61a6530-5474-405e-bf6e-8ffc6301e4f6-kube-api-access-ts6wk\") pod \"openshift-state-metrics-54cf96dfcf-z88db\" (UID: \"a61a6530-5474-405e-bf6e-8ffc6301e4f6\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" Jul 07 13:52:51.047518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.047372 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-accelerators-collector-config\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.047518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.047389 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe906d88-1dae-4b85-a216-e1f9a50ab607-metrics-client-ca\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.047518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.047395 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe906d88-1dae-4b85-a216-e1f9a50ab607-sys\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.047518 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.047435 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe906d88-1dae-4b85-a216-e1f9a50ab607-sys\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.049081 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:51.047554 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 13:52:51.049081 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:51.047615 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-tls podName:fe906d88-1dae-4b85-a216-e1f9a50ab607 nodeName:}" failed. No retries permitted until 2026-07-07 13:52:51.547597231 +0000 UTC m=+118.412801681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-tls") pod "node-exporter-mzn5f" (UID: "fe906d88-1dae-4b85-a216-e1f9a50ab607") : secret "node-exporter-tls" not found Jul 07 13:52:51.049081 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.048101 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a61a6530-5474-405e-bf6e-8ffc6301e4f6-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-z88db\" (UID: \"a61a6530-5474-405e-bf6e-8ffc6301e4f6\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" Jul 07 13:52:51.049081 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.048255 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-accelerators-collector-config\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.049081 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.048449 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-textfile\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.051004 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.050764 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.051004 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.050936 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a61a6530-5474-405e-bf6e-8ffc6301e4f6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-z88db\" (UID: \"a61a6530-5474-405e-bf6e-8ffc6301e4f6\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" Jul 07 13:52:51.056044 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.056019 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a61a6530-5474-405e-bf6e-8ffc6301e4f6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-z88db\" (UID: \"a61a6530-5474-405e-bf6e-8ffc6301e4f6\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" Jul 07 13:52:51.068352 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.068280 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts6wk\" (UniqueName: \"kubernetes.io/projected/a61a6530-5474-405e-bf6e-8ffc6301e4f6-kube-api-access-ts6wk\") pod \"openshift-state-metrics-54cf96dfcf-z88db\" (UID: \"a61a6530-5474-405e-bf6e-8ffc6301e4f6\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" Jul 07 13:52:51.070285 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.070258 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67v6s\" (UniqueName: \"kubernetes.io/projected/fe906d88-1dae-4b85-a216-e1f9a50ab607-kube-api-access-67v6s\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.088529 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.087170 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" Jul 07 13:52:51.257166 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.257136 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db"] Jul 07 13:52:51.259822 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:52:51.259791 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61a6530_5474_405e_bf6e_8ffc6301e4f6.slice/crio-0f66aa0ee1495f46b357fe25d553244c27be464e262d4221a2684a8564df35ab WatchSource:0}: Error finding container 0f66aa0ee1495f46b357fe25d553244c27be464e262d4221a2684a8564df35ab: Status 404 returned error can't find the container with id 0f66aa0ee1495f46b357fe25d553244c27be464e262d4221a2684a8564df35ab Jul 07 13:52:51.457381 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.457327 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:51.460363 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.460334 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-glqq4\" (UID: \"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:51.558741 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.558658 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-tls\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.561262 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.561234 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe906d88-1dae-4b85-a216-e1f9a50ab607-node-exporter-tls\") pod \"node-exporter-mzn5f\" (UID: \"fe906d88-1dae-4b85-a216-e1f9a50ab607\") " pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.644922 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.644884 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" Jul 07 13:52:51.707295 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.707265 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mzn5f" Jul 07 13:52:51.725082 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:52:51.725042 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe906d88_1dae_4b85_a216_e1f9a50ab607.slice/crio-91e4164528479ad44ed44602f5f5bed3ce61e827115320d3bd0c599c46e5109a WatchSource:0}: Error finding container 91e4164528479ad44ed44602f5f5bed3ce61e827115320d3bd0c599c46e5109a: Status 404 returned error can't find the container with id 91e4164528479ad44ed44602f5f5bed3ce61e827115320d3bd0c599c46e5109a Jul 07 13:52:51.804973 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.804878 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4"] Jul 07 13:52:51.807532 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:52:51.807505 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded72dcf5_92f6_409f_a80e_be6e0e0d2ba6.slice/crio-278e5b9250fa708f937ccd50697891a89fb4f19d0184189c0f042485246eabb1 WatchSource:0}: Error finding container 278e5b9250fa708f937ccd50697891a89fb4f19d0184189c0f042485246eabb1: Status 404 returned error can't find the container with id 278e5b9250fa708f937ccd50697891a89fb4f19d0184189c0f042485246eabb1 Jul 07 13:52:51.847295 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.847262 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:52:51.850576 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.850547 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:51.852868 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.852842 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 13:52:51.853860 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.853842 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 13:52:51.854073 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.854061 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 13:52:51.854165 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.854147 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 13:52:51.854219 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.854166 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 13:52:51.854219 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.854151 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nrjd8\"" Jul 07 13:52:51.854443 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.854420 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 13:52:51.854551 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.854447 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 13:52:51.854551 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.854423 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 13:52:51.854847 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.854811 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 13:52:51.866780 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.866751 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:52:51.961622 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.961586 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:51.961801 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.961644 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:51.961801 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.961671 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:51.961801 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.961710 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:51.961801 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.961739 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:51.961801 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.961762 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64vxz\" (UniqueName: \"kubernetes.io/projected/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-kube-api-access-64vxz\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:51.961801 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.961790 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-web-config\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:51.962115 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.961824 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:51.962115 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.961862 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:51.962115 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.961900 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-config-volume\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:51.962115 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.961926 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:51.962115 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.961964 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:51.962115 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:51.962012 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-config-out\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.062954 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.062870 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-config-volume\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.062954 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.062912 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.062954 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.062946 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.063208 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.062979 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-config-out\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.063446 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.063409 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.063550 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.063472 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.063550 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.063499 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.063550 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:52:52.063524 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-alertmanager-trusted-ca-bundle podName:3b844b09-21d8-49e3-8fcf-10f7a6e36e9b nodeName:}" failed. No retries permitted until 2026-07-07 13:52:52.563500791 +0000 UTC m=+119.428705246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b") : configmap references non-existent config key: ca-bundle.crt Jul 07 13:52:52.063709 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.063586 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.063709 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.063628 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.063709 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.063670 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64vxz\" (UniqueName: \"kubernetes.io/projected/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-kube-api-access-64vxz\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.063709 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.063696 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.063709 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.063708 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-web-config\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.065142 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.063756 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.065142 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.063779 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.065142 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.064740 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.066084 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.066021 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-config-out\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.066198 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.066155 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.066318 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.066294 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.066548 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.066524 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-config-volume\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.067370 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.067320 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.067370 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.067322 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-web-config\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.068102 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.068082 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.068685 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.068658 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.069062 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.069040 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.077313 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.077285 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64vxz\" (UniqueName: \"kubernetes.io/projected/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-kube-api-access-64vxz\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.188656 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.188619 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" event={"ID":"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6","Type":"ContainerStarted","Data":"278e5b9250fa708f937ccd50697891a89fb4f19d0184189c0f042485246eabb1"} Jul 07 13:52:52.190986 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.190959 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" event={"ID":"a61a6530-5474-405e-bf6e-8ffc6301e4f6","Type":"ContainerStarted","Data":"e59dfaac7c1d1acc0d78fcdd85cb35f6661d2ae3cfd3480e077cd85dcddfe4ed"} Jul 07 13:52:52.191121 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.191022 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" event={"ID":"a61a6530-5474-405e-bf6e-8ffc6301e4f6","Type":"ContainerStarted","Data":"ab860acf67f24dce9fd2834e08d35617ec0bb6f47c96a90bee9ae4f8f1654b61"} Jul 07 13:52:52.191121 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.191053 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" event={"ID":"a61a6530-5474-405e-bf6e-8ffc6301e4f6","Type":"ContainerStarted","Data":"0f66aa0ee1495f46b357fe25d553244c27be464e262d4221a2684a8564df35ab"} Jul 07 13:52:52.192873 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.192819 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mzn5f" event={"ID":"fe906d88-1dae-4b85-a216-e1f9a50ab607","Type":"ContainerStarted","Data":"91e4164528479ad44ed44602f5f5bed3ce61e827115320d3bd0c599c46e5109a"} Jul 07 13:52:52.569863 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.569099 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.570668 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.570628 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.761234 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.761131 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:52:52.881299 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:52.881131 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:52:53.460820 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:53.460785 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:52:53.468080 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:52:53.468041 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b844b09_21d8_49e3_8fcf_10f7a6e36e9b.slice/crio-8d9b68fc952098e05e96faa6de75fa1f626d74576eba82aad00bfd603ae5d97e WatchSource:0}: Error finding container 8d9b68fc952098e05e96faa6de75fa1f626d74576eba82aad00bfd603ae5d97e: Status 404 returned error can't find the container with id 8d9b68fc952098e05e96faa6de75fa1f626d74576eba82aad00bfd603ae5d97e Jul 07 13:52:54.139796 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:54.139759 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:54.140276 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:54.139851 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:54.146393 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:54.146366 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:54.203449 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:54.203416 2560 generic.go:356] "Generic (PLEG): container finished" podID="fe906d88-1dae-4b85-a216-e1f9a50ab607" containerID="907a9bd58a176268fd94e4d58a6042cc029e8590e9dcd8e362a73faf5dde2fa2" exitCode=0 Jul 07 13:52:54.203608 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:54.203550 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mzn5f" event={"ID":"fe906d88-1dae-4b85-a216-e1f9a50ab607","Type":"ContainerDied","Data":"907a9bd58a176268fd94e4d58a6042cc029e8590e9dcd8e362a73faf5dde2fa2"} Jul 07 13:52:54.206668 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:54.206616 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" event={"ID":"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6","Type":"ContainerStarted","Data":"50e43c93acc03045a3044df8dd4bf8d27fb8c2da7942249e6d44bb12773eea15"} Jul 07 13:52:54.206791 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:54.206677 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" event={"ID":"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6","Type":"ContainerStarted","Data":"702a6d54809f5e082eae8d8a943416905d6ea044ee46bc423a4020e0150ecf3d"} Jul 07 13:52:54.206791 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:54.206707 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" event={"ID":"ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6","Type":"ContainerStarted","Data":"2795aeac66f4427ffb42c8fba480d963a027eda056e007c7d21b479f298eb012"} Jul 07 13:52:54.209820 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:54.209784 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" event={"ID":"a61a6530-5474-405e-bf6e-8ffc6301e4f6","Type":"ContainerStarted","Data":"e41102d7150b95c2f5016dd4b791ab8e3eba8f4ec2e4f2edf0b36c9b02f5a71e"} Jul 07 13:52:54.212796 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:54.212766 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b","Type":"ContainerStarted","Data":"8d9b68fc952098e05e96faa6de75fa1f626d74576eba82aad00bfd603ae5d97e"} Jul 07 13:52:54.218022 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:54.218000 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:52:54.248262 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:54.248210 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z88db" podStartSLOduration=2.372907888 podStartE2EDuration="4.24818993s" totalImagesPullingTime="1.875282042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:52:54.246789079 +0000 UTC m=+121.111993543" watchObservedRunningTime="2026-07-07 13:52:54.24818993 +0000 UTC m=+121.113394395" Jul 07 13:52:54.292558 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:54.292432 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-glqq4" podStartSLOduration=2.827015358 podStartE2EDuration="4.292412638s" totalImagesPullingTime="1.46539728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:52:54.290934723 +0000 UTC m=+121.156139189" watchObservedRunningTime="2026-07-07 13:52:54.292412638 +0000 UTC m=+121.157617103" Jul 07 13:52:55.084068 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.084031 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7989f86898-jsrlb"] Jul 07 13:52:55.087409 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.087389 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.089738 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.089717 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 13:52:55.089979 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.089962 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-34apea4inmuit\"" Jul 07 13:52:55.090553 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.090530 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 13:52:55.091285 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.091260 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-x27lj\"" Jul 07 13:52:55.091384 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.091298 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 13:52:55.091443 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.091403 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 13:52:55.098499 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.098478 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7989f86898-jsrlb"] Jul 07 13:52:55.195540 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.195505 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/376791a7-3947-4c6e-8b15-c5faa8533f6a-secret-metrics-server-client-certs\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.195965 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.195566 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/376791a7-3947-4c6e-8b15-c5faa8533f6a-client-ca-bundle\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.195965 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.195593 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/376791a7-3947-4c6e-8b15-c5faa8533f6a-audit-log\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.195965 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.195616 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/376791a7-3947-4c6e-8b15-c5faa8533f6a-secret-metrics-server-tls\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.195965 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.195723 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/376791a7-3947-4c6e-8b15-c5faa8533f6a-metrics-server-audit-profiles\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.195965 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.195769 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6h6d\" (UniqueName: \"kubernetes.io/projected/376791a7-3947-4c6e-8b15-c5faa8533f6a-kube-api-access-x6h6d\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.195965 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.195798 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376791a7-3947-4c6e-8b15-c5faa8533f6a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.218159 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.218124 2560 generic.go:356] "Generic (PLEG): container finished" podID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerID="ea475f34f1051d5bb68404eeb4a08204f6ea769080646bc5bf4e49d21369b5d5" exitCode=0 Jul 07 13:52:55.218314 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.218217 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b","Type":"ContainerDied","Data":"ea475f34f1051d5bb68404eeb4a08204f6ea769080646bc5bf4e49d21369b5d5"} Jul 07 13:52:55.220586 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.220510 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mzn5f" event={"ID":"fe906d88-1dae-4b85-a216-e1f9a50ab607","Type":"ContainerStarted","Data":"220d82205800aec5c52fd22cb6e7e37f8aa375288fff8111fa8549bfa8a1a164"} Jul 07 13:52:55.220586 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.220560 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mzn5f" event={"ID":"fe906d88-1dae-4b85-a216-e1f9a50ab607","Type":"ContainerStarted","Data":"23e8e1dbf01543a33a82438c6a585ca54338ffcbae546be5c879261064668276"} Jul 07 13:52:55.262599 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.262544 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mzn5f" podStartSLOduration=3.636299594 podStartE2EDuration="5.262522336s" totalImagesPullingTime="1.546918553s" totalInitContainerRuntime="79.304189ms" isStatefulPod=true podCreationTimestamp="2026-07-07 13:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:52:55.260915646 +0000 UTC m=+122.126120111" watchObservedRunningTime="2026-07-07 13:52:55.262522336 +0000 UTC m=+122.127726801" Jul 07 13:52:55.297401 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.297256 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/376791a7-3947-4c6e-8b15-c5faa8533f6a-secret-metrics-server-client-certs\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.297576 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.297531 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/376791a7-3947-4c6e-8b15-c5faa8533f6a-client-ca-bundle\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.298972 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.297736 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/376791a7-3947-4c6e-8b15-c5faa8533f6a-audit-log\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.298972 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.297810 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/376791a7-3947-4c6e-8b15-c5faa8533f6a-secret-metrics-server-tls\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.298972 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.298117 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/376791a7-3947-4c6e-8b15-c5faa8533f6a-audit-log\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.298972 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.298186 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/376791a7-3947-4c6e-8b15-c5faa8533f6a-metrics-server-audit-profiles\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.298972 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.298215 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6h6d\" (UniqueName: \"kubernetes.io/projected/376791a7-3947-4c6e-8b15-c5faa8533f6a-kube-api-access-x6h6d\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.298972 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.298319 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376791a7-3947-4c6e-8b15-c5faa8533f6a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.299581 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.299538 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/376791a7-3947-4c6e-8b15-c5faa8533f6a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.299854 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.299793 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/376791a7-3947-4c6e-8b15-c5faa8533f6a-metrics-server-audit-profiles\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.300315 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.300291 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/376791a7-3947-4c6e-8b15-c5faa8533f6a-secret-metrics-server-client-certs\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.300474 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.300455 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/376791a7-3947-4c6e-8b15-c5faa8533f6a-secret-metrics-server-tls\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.300555 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.300532 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/376791a7-3947-4c6e-8b15-c5faa8533f6a-client-ca-bundle\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.306915 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.306896 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6h6d\" (UniqueName: \"kubernetes.io/projected/376791a7-3947-4c6e-8b15-c5faa8533f6a-kube-api-access-x6h6d\") pod \"metrics-server-7989f86898-jsrlb\" (UID: \"376791a7-3947-4c6e-8b15-c5faa8533f6a\") " pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.399348 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.399264 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:52:55.550083 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:55.550057 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7989f86898-jsrlb"] Jul 07 13:52:55.552786 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:52:55.552757 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod376791a7_3947_4c6e_8b15_c5faa8533f6a.slice/crio-98535c38f221a7eab91b71dbda9a330ed0fe00eb38cb439a4d610d00f5a3d721 WatchSource:0}: Error finding container 98535c38f221a7eab91b71dbda9a330ed0fe00eb38cb439a4d610d00f5a3d721: Status 404 returned error can't find the container with id 98535c38f221a7eab91b71dbda9a330ed0fe00eb38cb439a4d610d00f5a3d721 Jul 07 13:52:56.227406 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:56.227369 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" event={"ID":"376791a7-3947-4c6e-8b15-c5faa8533f6a","Type":"ContainerStarted","Data":"98535c38f221a7eab91b71dbda9a330ed0fe00eb38cb439a4d610d00f5a3d721"} Jul 07 13:52:57.201674 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.201638 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 13:52:57.205789 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.205762 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.212155 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.212128 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 13:52:57.213806 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.213684 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 13:52:57.214313 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.213953 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 13:52:57.214313 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.214026 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 13:52:57.214313 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.214113 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 13:52:57.214313 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.214182 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 13:52:57.214313 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.214027 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 13:52:57.214910 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.214471 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b3gvkd902emo8\"" Jul 07 13:52:57.214910 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.214596 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 13:52:57.214910 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.214700 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-thr8r\"" Jul 07 13:52:57.214910 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.214871 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 13:52:57.214910 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.214890 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 13:52:57.215433 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.215279 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 13:52:57.215433 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.215347 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 13:52:57.219548 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.219517 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 13:52:57.223172 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.223153 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 13:52:57.233493 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.233469 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 13:52:57.318907 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.318874 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-config\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319077 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.318915 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319077 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.318943 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319077 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.318997 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-web-config\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319247 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.319081 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319247 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.319156 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/602d86b6-fccb-4577-9ca1-1892c686cfc0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319247 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.319215 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319416 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.319259 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319416 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.319290 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319416 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.319341 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319416 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.319365 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319416 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.319398 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319668 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.319423 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319668 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.319444 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319668 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.319464 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319668 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.319518 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/602d86b6-fccb-4577-9ca1-1892c686cfc0-config-out\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319668 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.319542 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319668 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.319568 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319668 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.319597 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.319668 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.319652 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pct6r\" (UniqueName: \"kubernetes.io/projected/602d86b6-fccb-4577-9ca1-1892c686cfc0-kube-api-access-pct6r\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.420965 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.420920 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-config\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.420965 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.420965 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.421184 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.421127 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.421184 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.421160 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-web-config\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.421278 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.421213 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.421278 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.421260 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/602d86b6-fccb-4577-9ca1-1892c686cfc0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.421368 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.421324 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.423199 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.421975 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.423199 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.422050 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.423199 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.422083 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.423199 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.422117 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.423199 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.422145 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.423199 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.422177 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.423199 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.422210 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.423199 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.422240 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.423199 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.422262 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.423199 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.422297 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/602d86b6-fccb-4577-9ca1-1892c686cfc0-config-out\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.423199 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.422324 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.423199 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.422347 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.423199 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.422375 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.423199 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.422409 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pct6r\" (UniqueName: \"kubernetes.io/projected/602d86b6-fccb-4577-9ca1-1892c686cfc0-kube-api-access-pct6r\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.423968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.423943 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-config\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.425818 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.424299 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.425818 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.424454 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-web-config\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.425818 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.424589 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.425818 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.424972 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.425818 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.425182 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.425818 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.425224 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.425818 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.425321 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.425818 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.425394 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/602d86b6-fccb-4577-9ca1-1892c686cfc0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.425818 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.425522 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.425818 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.425724 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.426352 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.426154 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.426658 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.426532 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.427634 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.427573 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/602d86b6-fccb-4577-9ca1-1892c686cfc0-config-out\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.428328 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.428304 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.428555 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.428531 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.428680 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.428595 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.428680 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.428649 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.431030 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.431010 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pct6r\" (UniqueName: \"kubernetes.io/projected/602d86b6-fccb-4577-9ca1-1892c686cfc0-kube-api-access-pct6r\") pod \"prometheus-k8s-0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:52:57.518352 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:52:57.518269 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:53:00.812926 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:00.812884 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75fc46f75d-lb6v6"] Jul 07 13:53:02.589180 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.589146 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-769494575f-wcq6z"] Jul 07 13:53:02.799577 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.799543 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-769494575f-wcq6z"] Jul 07 13:53:02.799709 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.799657 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.807078 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.807059 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 13:53:02.877382 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.877298 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-console-config\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.877382 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.877359 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-oauth-serving-cert\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.877552 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.877500 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d65f4\" (UniqueName: \"kubernetes.io/projected/73eae971-ab67-4197-a0cd-0288b760124b-kube-api-access-d65f4\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.877552 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.877544 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73eae971-ab67-4197-a0cd-0288b760124b-console-oauth-config\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.877681 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.877576 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-trusted-ca-bundle\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.877681 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.877646 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73eae971-ab67-4197-a0cd-0288b760124b-console-serving-cert\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.877681 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.877661 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-service-ca\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.978884 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.978848 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73eae971-ab67-4197-a0cd-0288b760124b-console-serving-cert\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.979076 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.978896 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-service-ca\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.979076 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.978934 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-console-config\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.979076 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.978974 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-oauth-serving-cert\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.979076 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.979034 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d65f4\" (UniqueName: \"kubernetes.io/projected/73eae971-ab67-4197-a0cd-0288b760124b-kube-api-access-d65f4\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.979282 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.979081 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73eae971-ab67-4197-a0cd-0288b760124b-console-oauth-config\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.979282 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.979113 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-trusted-ca-bundle\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.979775 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.979722 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-oauth-serving-cert\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.979919 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.979773 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-service-ca\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.979919 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.979798 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-console-config\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.980038 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.980018 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-trusted-ca-bundle\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.981770 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.981746 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73eae971-ab67-4197-a0cd-0288b760124b-console-serving-cert\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.981976 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.981958 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73eae971-ab67-4197-a0cd-0288b760124b-console-oauth-config\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:02.987676 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:02.987652 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d65f4\" (UniqueName: \"kubernetes.io/projected/73eae971-ab67-4197-a0cd-0288b760124b-kube-api-access-d65f4\") pod \"console-769494575f-wcq6z\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:03.109027 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:03.108995 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:03.484760 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:03.484634 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs\") pod \"network-metrics-daemon-jvz97\" (UID: \"25b6321b-a8db-4404-8e21-36dffa3f4585\") " pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:53:03.487809 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:03.487752 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25b6321b-a8db-4404-8e21-36dffa3f4585-metrics-certs\") pod \"network-metrics-daemon-jvz97\" (UID: \"25b6321b-a8db-4404-8e21-36dffa3f4585\") " pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:53:03.635089 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:03.635037 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 13:53:03.637740 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:03.637710 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-769494575f-wcq6z"] Jul 07 13:53:03.639286 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:53:03.639257 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73eae971_ab67_4197_a0cd_0288b760124b.slice/crio-ceca03a6d0c757ec0251ae97e6f7d0f70eb77002e4a860d8d57273d87c52df34 WatchSource:0}: Error finding container ceca03a6d0c757ec0251ae97e6f7d0f70eb77002e4a860d8d57273d87c52df34: Status 404 returned error can't find the container with id ceca03a6d0c757ec0251ae97e6f7d0f70eb77002e4a860d8d57273d87c52df34 Jul 07 13:53:03.652294 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:03.652273 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xl4wk\"" Jul 07 13:53:03.659894 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:03.659848 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvz97" Jul 07 13:53:03.858551 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:03.858471 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jvz97"] Jul 07 13:53:03.864004 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:53:03.863952 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b6321b_a8db_4404_8e21_36dffa3f4585.slice/crio-0f09012a7a226c11bbf4d9bf03b73628c3819970c12784716f0ca69af91702c8 WatchSource:0}: Error finding container 0f09012a7a226c11bbf4d9bf03b73628c3819970c12784716f0ca69af91702c8: Status 404 returned error can't find the container with id 0f09012a7a226c11bbf4d9bf03b73628c3819970c12784716f0ca69af91702c8 Jul 07 13:53:04.268900 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:04.268110 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-dlgcz" event={"ID":"63807a3d-4229-4a12-85cf-2be9e56ce961","Type":"ContainerStarted","Data":"36ba5d7b23ae6e46a13da74aeba87d7df0e7499ec7be9348eb2b525047b3521f"} Jul 07 13:53:04.269315 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:04.269291 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-dlgcz" Jul 07 13:53:04.271448 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:04.271409 2560 generic.go:356] "Generic (PLEG): container finished" podID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerID="737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61" exitCode=0 Jul 07 13:53:04.271747 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:04.271720 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"602d86b6-fccb-4577-9ca1-1892c686cfc0","Type":"ContainerDied","Data":"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61"} Jul 07 13:53:04.271877 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:04.271799 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"602d86b6-fccb-4577-9ca1-1892c686cfc0","Type":"ContainerStarted","Data":"fbe7232c09cb2f0f68c6b9fa571c20566c5a5fe1382a5989d2fdfeb10240ede3"} Jul 07 13:53:04.273214 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:04.273048 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jvz97" event={"ID":"25b6321b-a8db-4404-8e21-36dffa3f4585","Type":"ContainerStarted","Data":"0f09012a7a226c11bbf4d9bf03b73628c3819970c12784716f0ca69af91702c8"} Jul 07 13:53:04.280152 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:04.280132 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-dlgcz" Jul 07 13:53:04.281694 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:04.281496 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b","Type":"ContainerStarted","Data":"bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e"} Jul 07 13:53:04.281694 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:04.281567 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b","Type":"ContainerStarted","Data":"c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153"} Jul 07 13:53:04.281694 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:04.281613 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b","Type":"ContainerStarted","Data":"66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7"} Jul 07 13:53:04.281694 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:04.281653 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b","Type":"ContainerStarted","Data":"4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893"} Jul 07 13:53:04.283817 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:04.283793 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769494575f-wcq6z" event={"ID":"73eae971-ab67-4197-a0cd-0288b760124b","Type":"ContainerStarted","Data":"2778ea0b281215e4c9995700d26c6d23a3fe8126e7e62d1e5ca8700ea5117b4b"} Jul 07 13:53:04.283923 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:04.283854 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769494575f-wcq6z" event={"ID":"73eae971-ab67-4197-a0cd-0288b760124b","Type":"ContainerStarted","Data":"ceca03a6d0c757ec0251ae97e6f7d0f70eb77002e4a860d8d57273d87c52df34"} Jul 07 13:53:04.287908 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:04.287864 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-dlgcz" podStartSLOduration=2.405057594 podStartE2EDuration="22.287823885s" totalImagesPullingTime="19.882766291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:53:04.286815413 +0000 UTC m=+131.152019924" watchObservedRunningTime="2026-07-07 13:53:04.287823885 +0000 UTC m=+131.153028350" Jul 07 13:53:04.357259 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:04.357169 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-769494575f-wcq6z" podStartSLOduration=2.357146879 podStartE2EDuration="2.357146879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:53:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:53:04.356213982 +0000 UTC m=+131.221418446" watchObservedRunningTime="2026-07-07 13:53:04.357146879 +0000 UTC m=+131.222351345" Jul 07 13:53:05.298249 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:05.298149 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" event={"ID":"376791a7-3947-4c6e-8b15-c5faa8533f6a","Type":"ContainerStarted","Data":"c8868adb5b81c8f71519b087e14454dcb31660b6668a900d604ce374ae99c96c"} Jul 07 13:53:05.307474 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:05.307310 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b","Type":"ContainerStarted","Data":"b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d"} Jul 07 13:53:05.316317 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:05.316151 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" podStartSLOduration=1.008283444 podStartE2EDuration="10.316130062s" totalImagesPullingTime="9.307846618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:53:05.314162662 +0000 UTC m=+132.179367126" watchObservedRunningTime="2026-07-07 13:53:05.316130062 +0000 UTC m=+132.181334527" Jul 07 13:53:07.321343 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:07.321303 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jvz97" event={"ID":"25b6321b-a8db-4404-8e21-36dffa3f4585","Type":"ContainerStarted","Data":"57fd94d1edf7550d30788a3dcba99bb0bc4ca7bdade56033259e37b0f812f070"} Jul 07 13:53:07.321859 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:07.321375 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jvz97" event={"ID":"25b6321b-a8db-4404-8e21-36dffa3f4585","Type":"ContainerStarted","Data":"d7a27c5d5faf2e53fa49f0dbd7d177cbd1606cb1c02b0dc38f91aebbd1574ac0"} Jul 07 13:53:07.327730 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:07.327699 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b","Type":"ContainerStarted","Data":"b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25"} Jul 07 13:53:07.389733 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:07.389098 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.058303558 podStartE2EDuration="16.389074503s" totalImagesPullingTime="11.315625189s" totalInitContainerRuntime="15.145756ms" isStatefulPod=false podCreationTimestamp="2026-07-07 13:52:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:53:07.377378452 +0000 UTC m=+134.242582917" watchObservedRunningTime="2026-07-07 13:53:07.389074503 +0000 UTC m=+134.254278967" Jul 07 13:53:07.391302 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:07.390596 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jvz97" podStartSLOduration=131.859817734 podStartE2EDuration="2m14.390581518s" totalImagesPullingTime="2.530763784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:53:07.343797823 +0000 UTC m=+134.209002289" watchObservedRunningTime="2026-07-07 13:53:07.390581518 +0000 UTC m=+134.255785982" Jul 07 13:53:07.896027 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:07.895966 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" podUID="69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f" containerName="registry" containerID="cri-o://c698fd229e1827a4751405350b12609e334cf81dcb1a2844df4f28142a49516e" gracePeriod=30 Jul 07 13:53:08.565466 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.565433 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:53:08.639768 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.639679 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-certificates\") pod \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " Jul 07 13:53:08.639929 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.639780 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-trusted-ca\") pod \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " Jul 07 13:53:08.639929 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.639902 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-bound-sa-token\") pod \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " Jul 07 13:53:08.640063 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.639939 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-installation-pull-secrets\") pod \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " Jul 07 13:53:08.640063 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.640009 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-ca-trust-extracted\") pod \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " Jul 07 13:53:08.640063 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.640046 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-image-registry-private-configuration\") pod \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " Jul 07 13:53:08.640207 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.640076 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl4cw\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-kube-api-access-cl4cw\") pod \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " Jul 07 13:53:08.640207 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.640100 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls\") pod \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\" (UID: \"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f\") " Jul 07 13:53:08.640207 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.640112 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f" (UID: "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:53:08.640768 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.640399 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-certificates\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:53:08.643157 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.643117 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f" (UID: "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:53:08.643340 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.643314 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f" (UID: "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:53:08.643427 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.643356 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f" (UID: "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:53:08.643897 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.643873 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f" (UID: "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:53:08.643978 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.643877 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f" (UID: "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:53:08.644756 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.644724 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-kube-api-access-cl4cw" (OuterVolumeSpecName: "kube-api-access-cl4cw") pod "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f" (UID: "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f"). InnerVolumeSpecName "kube-api-access-cl4cw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:53:08.651401 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.651376 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f" (UID: "69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:53:08.741416 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.741375 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-ca-trust-extracted\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:53:08.741416 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.741419 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-image-registry-private-configuration\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:53:08.741620 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.741435 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl4cw\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-kube-api-access-cl4cw\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:53:08.741620 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.741450 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-registry-tls\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:53:08.741620 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.741461 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-trusted-ca\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:53:08.741620 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.741468 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-bound-sa-token\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:53:08.741620 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:08.741494 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f-installation-pull-secrets\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:53:09.340032 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:09.339989 2560 generic.go:356] "Generic (PLEG): container finished" podID="69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f" containerID="c698fd229e1827a4751405350b12609e334cf81dcb1a2844df4f28142a49516e" exitCode=0 Jul 07 13:53:09.340218 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:09.340041 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" Jul 07 13:53:09.340218 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:09.340076 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" event={"ID":"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f","Type":"ContainerDied","Data":"c698fd229e1827a4751405350b12609e334cf81dcb1a2844df4f28142a49516e"} Jul 07 13:53:09.340218 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:09.340128 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cc4df75c8-lcqsr" event={"ID":"69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f","Type":"ContainerDied","Data":"bc49259ede86fbbd759de9f09e88a894ab80f4d71434c046357c2f4d89b488b6"} Jul 07 13:53:09.340218 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:09.340152 2560 scope.go:117] "RemoveContainer" containerID="c698fd229e1827a4751405350b12609e334cf81dcb1a2844df4f28142a49516e" Jul 07 13:53:09.343060 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:09.343033 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"602d86b6-fccb-4577-9ca1-1892c686cfc0","Type":"ContainerStarted","Data":"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403"} Jul 07 13:53:09.343188 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:09.343106 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"602d86b6-fccb-4577-9ca1-1892c686cfc0","Type":"ContainerStarted","Data":"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb"} Jul 07 13:53:09.350927 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:09.350906 2560 scope.go:117] "RemoveContainer" containerID="c698fd229e1827a4751405350b12609e334cf81dcb1a2844df4f28142a49516e" Jul 07 13:53:09.351265 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:53:09.351242 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c698fd229e1827a4751405350b12609e334cf81dcb1a2844df4f28142a49516e\": container with ID starting with c698fd229e1827a4751405350b12609e334cf81dcb1a2844df4f28142a49516e not found: ID does not exist" containerID="c698fd229e1827a4751405350b12609e334cf81dcb1a2844df4f28142a49516e" Jul 07 13:53:09.351336 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:09.351271 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c698fd229e1827a4751405350b12609e334cf81dcb1a2844df4f28142a49516e"} err="failed to get container status \"c698fd229e1827a4751405350b12609e334cf81dcb1a2844df4f28142a49516e\": rpc error: code = NotFound desc = could not find container \"c698fd229e1827a4751405350b12609e334cf81dcb1a2844df4f28142a49516e\": container with ID starting with c698fd229e1827a4751405350b12609e334cf81dcb1a2844df4f28142a49516e not found: ID does not exist" Jul 07 13:53:09.364094 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:09.364041 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cc4df75c8-lcqsr"] Jul 07 13:53:09.367903 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:09.367877 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-cc4df75c8-lcqsr"] Jul 07 13:53:09.734119 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:09.734039 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f" path="/var/lib/kubelet/pods/69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f/volumes" Jul 07 13:53:12.371547 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:12.371513 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"602d86b6-fccb-4577-9ca1-1892c686cfc0","Type":"ContainerStarted","Data":"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8"} Jul 07 13:53:12.371927 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:12.371583 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"602d86b6-fccb-4577-9ca1-1892c686cfc0","Type":"ContainerStarted","Data":"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1"} Jul 07 13:53:12.371927 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:12.371609 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"602d86b6-fccb-4577-9ca1-1892c686cfc0","Type":"ContainerStarted","Data":"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9"} Jul 07 13:53:13.109425 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:13.109385 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:13.109692 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:13.109448 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:13.114295 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:13.114271 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:13.383961 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:13.383858 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"602d86b6-fccb-4577-9ca1-1892c686cfc0","Type":"ContainerStarted","Data":"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7"} Jul 07 13:53:13.387922 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:13.387901 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:53:13.460909 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:13.460855 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=8.999865477 podStartE2EDuration="16.460799673s" totalImagesPullingTime="7.419467871s" totalInitContainerRuntime="41.466325ms" isStatefulPod=false podCreationTimestamp="2026-07-07 13:52:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:53:13.423467591 +0000 UTC m=+140.288672069" watchObservedRunningTime="2026-07-07 13:53:13.460799673 +0000 UTC m=+140.326004138" Jul 07 13:53:15.399756 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:15.399724 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:53:15.400155 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:15.399806 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:53:17.518608 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:17.518569 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:53:24.434227 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:24.434189 2560 generic.go:356] "Generic (PLEG): container finished" podID="a538900d-f764-4db2-9441-2b5f4338fe03" containerID="a4cd30274fcd9eef1bc509ad96973d7c9453ce5a4bd47e99feee7f762161b5bf" exitCode=0 Jul 07 13:53:24.434712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:24.434260 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" event={"ID":"a538900d-f764-4db2-9441-2b5f4338fe03","Type":"ContainerDied","Data":"a4cd30274fcd9eef1bc509ad96973d7c9453ce5a4bd47e99feee7f762161b5bf"} Jul 07 13:53:24.434712 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:24.434607 2560 scope.go:117] "RemoveContainer" containerID="a4cd30274fcd9eef1bc509ad96973d7c9453ce5a4bd47e99feee7f762161b5bf" Jul 07 13:53:25.020858 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:25.020822 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5wh59_52b308d7-d010-494b-95d4-76f812b474b0/dns/0.log" Jul 07 13:53:25.221338 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:25.221307 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5wh59_52b308d7-d010-494b-95d4-76f812b474b0/kube-rbac-proxy/0.log" Jul 07 13:53:25.440708 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:25.440667 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jlsz5" event={"ID":"a538900d-f764-4db2-9441-2b5f4338fe03","Type":"ContainerStarted","Data":"0c10f9a2c55a8043f74ad14a674dad369ce43b40b11a6b9904085fab1b4eca69"} Jul 07 13:53:25.840984 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:25.840946 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-75fc46f75d-lb6v6" podUID="418d998f-1b7d-4a62-8152-c70fa78a6598" containerName="console" containerID="cri-o://5bac7458d8d2ce1041a470582bd7ebd58ecb447b861802730cc2944c144c055f" gracePeriod=15 Jul 07 13:53:26.134006 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.133971 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:53:26.304963 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.304926 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-service-ca\") pod \"418d998f-1b7d-4a62-8152-c70fa78a6598\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " Jul 07 13:53:26.305176 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.304978 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-oauth-serving-cert\") pod \"418d998f-1b7d-4a62-8152-c70fa78a6598\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " Jul 07 13:53:26.305176 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.305012 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/418d998f-1b7d-4a62-8152-c70fa78a6598-console-serving-cert\") pod \"418d998f-1b7d-4a62-8152-c70fa78a6598\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " Jul 07 13:53:26.305176 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.305080 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-console-config\") pod \"418d998f-1b7d-4a62-8152-c70fa78a6598\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " Jul 07 13:53:26.305176 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.305121 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/418d998f-1b7d-4a62-8152-c70fa78a6598-console-oauth-config\") pod \"418d998f-1b7d-4a62-8152-c70fa78a6598\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " Jul 07 13:53:26.305176 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.305164 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8kbs\" (UniqueName: \"kubernetes.io/projected/418d998f-1b7d-4a62-8152-c70fa78a6598-kube-api-access-g8kbs\") pod \"418d998f-1b7d-4a62-8152-c70fa78a6598\" (UID: \"418d998f-1b7d-4a62-8152-c70fa78a6598\") " Jul 07 13:53:26.305410 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.305340 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-service-ca" (OuterVolumeSpecName: "service-ca") pod "418d998f-1b7d-4a62-8152-c70fa78a6598" (UID: "418d998f-1b7d-4a62-8152-c70fa78a6598"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:53:26.305471 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.305435 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-service-ca\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:53:26.305471 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.305445 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-console-config" (OuterVolumeSpecName: "console-config") pod "418d998f-1b7d-4a62-8152-c70fa78a6598" (UID: "418d998f-1b7d-4a62-8152-c70fa78a6598"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:53:26.305547 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.305474 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "418d998f-1b7d-4a62-8152-c70fa78a6598" (UID: "418d998f-1b7d-4a62-8152-c70fa78a6598"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:53:26.307221 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.307191 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/418d998f-1b7d-4a62-8152-c70fa78a6598-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "418d998f-1b7d-4a62-8152-c70fa78a6598" (UID: "418d998f-1b7d-4a62-8152-c70fa78a6598"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:53:26.307335 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.307264 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/418d998f-1b7d-4a62-8152-c70fa78a6598-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "418d998f-1b7d-4a62-8152-c70fa78a6598" (UID: "418d998f-1b7d-4a62-8152-c70fa78a6598"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:53:26.307380 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.307360 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/418d998f-1b7d-4a62-8152-c70fa78a6598-kube-api-access-g8kbs" (OuterVolumeSpecName: "kube-api-access-g8kbs") pod "418d998f-1b7d-4a62-8152-c70fa78a6598" (UID: "418d998f-1b7d-4a62-8152-c70fa78a6598"). InnerVolumeSpecName "kube-api-access-g8kbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:53:26.405969 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.405894 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-oauth-serving-cert\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:53:26.405969 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.405921 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/418d998f-1b7d-4a62-8152-c70fa78a6598-console-serving-cert\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:53:26.405969 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.405931 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/418d998f-1b7d-4a62-8152-c70fa78a6598-console-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:53:26.405969 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.405939 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/418d998f-1b7d-4a62-8152-c70fa78a6598-console-oauth-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:53:26.405969 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.405949 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8kbs\" (UniqueName: \"kubernetes.io/projected/418d998f-1b7d-4a62-8152-c70fa78a6598-kube-api-access-g8kbs\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:53:26.445655 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.445625 2560 generic.go:356] "Generic (PLEG): container finished" podID="418d998f-1b7d-4a62-8152-c70fa78a6598" containerID="5bac7458d8d2ce1041a470582bd7ebd58ecb447b861802730cc2944c144c055f" exitCode=0 Jul 07 13:53:26.446045 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.445672 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75fc46f75d-lb6v6" Jul 07 13:53:26.446045 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.445691 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75fc46f75d-lb6v6" event={"ID":"418d998f-1b7d-4a62-8152-c70fa78a6598","Type":"ContainerDied","Data":"5bac7458d8d2ce1041a470582bd7ebd58ecb447b861802730cc2944c144c055f"} Jul 07 13:53:26.446045 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.445730 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75fc46f75d-lb6v6" event={"ID":"418d998f-1b7d-4a62-8152-c70fa78a6598","Type":"ContainerDied","Data":"294d1885824cfc7af432b10ad8bfc8f6f0a55ce228c00d2d63c4d3461e5aa12f"} Jul 07 13:53:26.446045 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.445748 2560 scope.go:117] "RemoveContainer" containerID="5bac7458d8d2ce1041a470582bd7ebd58ecb447b861802730cc2944c144c055f" Jul 07 13:53:26.453906 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.453872 2560 scope.go:117] "RemoveContainer" containerID="5bac7458d8d2ce1041a470582bd7ebd58ecb447b861802730cc2944c144c055f" Jul 07 13:53:26.454129 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:53:26.454111 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bac7458d8d2ce1041a470582bd7ebd58ecb447b861802730cc2944c144c055f\": container with ID starting with 5bac7458d8d2ce1041a470582bd7ebd58ecb447b861802730cc2944c144c055f not found: ID does not exist" containerID="5bac7458d8d2ce1041a470582bd7ebd58ecb447b861802730cc2944c144c055f" Jul 07 13:53:26.454165 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.454135 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bac7458d8d2ce1041a470582bd7ebd58ecb447b861802730cc2944c144c055f"} err="failed to get container status \"5bac7458d8d2ce1041a470582bd7ebd58ecb447b861802730cc2944c144c055f\": rpc error: code = NotFound desc = could not find container \"5bac7458d8d2ce1041a470582bd7ebd58ecb447b861802730cc2944c144c055f\": container with ID starting with 5bac7458d8d2ce1041a470582bd7ebd58ecb447b861802730cc2944c144c055f not found: ID does not exist" Jul 07 13:53:26.470735 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.470714 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75fc46f75d-lb6v6"] Jul 07 13:53:26.473540 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.473521 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75fc46f75d-lb6v6"] Jul 07 13:53:26.620944 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:26.620915 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zbsrw_67f25601-a3a1-41ef-80da-a2a319e9e59d/dns-node-resolver/0.log" Jul 07 13:53:27.421482 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:27.421452 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r7hj6_e388ff14-7f6e-4166-ade2-4d895ed00f2c/serve-healthcheck-canary/0.log" Jul 07 13:53:27.732732 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:27.732653 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="418d998f-1b7d-4a62-8152-c70fa78a6598" path="/var/lib/kubelet/pods/418d998f-1b7d-4a62-8152-c70fa78a6598/volumes" Jul 07 13:53:35.404929 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:35.404901 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:53:35.408779 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:35.408755 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7989f86898-jsrlb" Jul 07 13:53:46.533893 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:46.533860 2560 generic.go:356] "Generic (PLEG): container finished" podID="456fa7a4-c5ab-49c3-aff7-1635fd2c5c35" containerID="68457339bc42eadbabaac9b8d1e9ff1c9b47183d5f1a6031614e7f30ed05b914" exitCode=0 Jul 07 13:53:46.534325 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:46.533931 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2" event={"ID":"456fa7a4-c5ab-49c3-aff7-1635fd2c5c35","Type":"ContainerDied","Data":"68457339bc42eadbabaac9b8d1e9ff1c9b47183d5f1a6031614e7f30ed05b914"} Jul 07 13:53:46.534325 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:46.534266 2560 scope.go:117] "RemoveContainer" containerID="68457339bc42eadbabaac9b8d1e9ff1c9b47183d5f1a6031614e7f30ed05b914" Jul 07 13:53:47.539542 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:47.539510 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-8h6h2" event={"ID":"456fa7a4-c5ab-49c3-aff7-1635fd2c5c35","Type":"ContainerStarted","Data":"93dcab5688bbb171589d919928b9cccf998ea74743917393d0f6f593c85d4f24"} Jul 07 13:53:57.518650 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:57.518606 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:53:57.574369 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:57.574340 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:53:57.594466 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:53:57.594439 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:11.200921 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:11.200888 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:54:11.201337 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:11.201230 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="alertmanager" containerID="cri-o://4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893" gracePeriod=120 Jul 07 13:54:11.201405 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:11.201277 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="kube-rbac-proxy-metric" containerID="cri-o://b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d" gracePeriod=120 Jul 07 13:54:11.201405 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:11.201358 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="kube-rbac-proxy" containerID="cri-o://bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e" gracePeriod=120 Jul 07 13:54:11.201405 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:11.201370 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="prom-label-proxy" containerID="cri-o://b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25" gracePeriod=120 Jul 07 13:54:11.201405 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:11.201291 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="kube-rbac-proxy-web" containerID="cri-o://c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153" gracePeriod=120 Jul 07 13:54:11.201596 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:11.201306 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="config-reloader" containerID="cri-o://66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7" gracePeriod=120 Jul 07 13:54:11.635543 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:11.635511 2560 generic.go:356] "Generic (PLEG): container finished" podID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerID="b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25" exitCode=0 Jul 07 13:54:11.635543 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:11.635534 2560 generic.go:356] "Generic (PLEG): container finished" podID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerID="bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e" exitCode=0 Jul 07 13:54:11.635543 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:11.635540 2560 generic.go:356] "Generic (PLEG): container finished" podID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerID="66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7" exitCode=0 Jul 07 13:54:11.635543 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:11.635545 2560 generic.go:356] "Generic (PLEG): container finished" podID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerID="4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893" exitCode=0 Jul 07 13:54:11.635792 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:11.635580 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b","Type":"ContainerDied","Data":"b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25"} Jul 07 13:54:11.635792 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:11.635634 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b","Type":"ContainerDied","Data":"bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e"} Jul 07 13:54:11.635792 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:11.635660 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b","Type":"ContainerDied","Data":"66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7"} Jul 07 13:54:11.635792 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:11.635685 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b","Type":"ContainerDied","Data":"4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893"} Jul 07 13:54:12.445576 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.445551 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.611000 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.610972 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-metrics-client-ca\") pod \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " Jul 07 13:54:12.611165 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.611015 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-main-tls\") pod \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " Jul 07 13:54:12.611165 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.611039 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-tls-assets\") pod \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " Jul 07 13:54:12.611165 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.611147 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-cluster-tls-config\") pod \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " Jul 07 13:54:12.611321 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.611205 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy-web\") pod \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " Jul 07 13:54:12.611321 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.611233 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-config-out\") pod \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " Jul 07 13:54:12.611321 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.611267 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy\") pod \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " Jul 07 13:54:12.611321 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.611291 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-config-volume\") pod \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " Jul 07 13:54:12.611321 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.611320 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-alertmanager-trusted-ca-bundle\") pod \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " Jul 07 13:54:12.611568 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.611344 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-alertmanager-main-db\") pod \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " Jul 07 13:54:12.611568 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.611343 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" (UID: "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:54:12.611568 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.611380 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " Jul 07 13:54:12.611568 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.611467 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-web-config\") pod \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " Jul 07 13:54:12.611568 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.611510 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64vxz\" (UniqueName: \"kubernetes.io/projected/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-kube-api-access-64vxz\") pod \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\" (UID: \"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b\") " Jul 07 13:54:12.611799 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.611776 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" (UID: "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:54:12.611882 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.611804 2560 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-metrics-client-ca\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:12.612226 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.612175 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" (UID: "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:54:12.614190 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.614154 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-config-volume" (OuterVolumeSpecName: "config-volume") pod "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" (UID: "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:12.614286 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.614248 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-kube-api-access-64vxz" (OuterVolumeSpecName: "kube-api-access-64vxz") pod "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" (UID: "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b"). InnerVolumeSpecName "kube-api-access-64vxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:54:12.614335 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.614295 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" (UID: "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:54:12.614378 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.614354 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-config-out" (OuterVolumeSpecName: "config-out") pod "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" (UID: "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:54:12.614424 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.614402 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" (UID: "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:12.614753 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.614734 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" (UID: "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:12.615550 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.615525 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" (UID: "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:12.615993 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.615970 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" (UID: "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:12.618478 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.618454 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" (UID: "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:12.625440 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.625411 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-web-config" (OuterVolumeSpecName: "web-config") pod "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" (UID: "3b844b09-21d8-49e3-8fcf-10f7a6e36e9b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:12.642615 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.642589 2560 generic.go:356] "Generic (PLEG): container finished" podID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerID="b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d" exitCode=0 Jul 07 13:54:12.642615 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.642614 2560 generic.go:356] "Generic (PLEG): container finished" podID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerID="c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153" exitCode=0 Jul 07 13:54:12.642754 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.642646 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b","Type":"ContainerDied","Data":"b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d"} Jul 07 13:54:12.642754 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.642661 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.642754 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.642708 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b","Type":"ContainerDied","Data":"c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153"} Jul 07 13:54:12.642754 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.642738 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b844b09-21d8-49e3-8fcf-10f7a6e36e9b","Type":"ContainerDied","Data":"8d9b68fc952098e05e96faa6de75fa1f626d74576eba82aad00bfd603ae5d97e"} Jul 07 13:54:12.642893 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.642772 2560 scope.go:117] "RemoveContainer" containerID="b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25" Jul 07 13:54:12.650743 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.650725 2560 scope.go:117] "RemoveContainer" containerID="b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d" Jul 07 13:54:12.657743 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.657725 2560 scope.go:117] "RemoveContainer" containerID="bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e" Jul 07 13:54:12.664661 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.664643 2560 scope.go:117] "RemoveContainer" containerID="c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153" Jul 07 13:54:12.668304 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.668283 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:54:12.672805 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.672787 2560 scope.go:117] "RemoveContainer" containerID="66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7" Jul 07 13:54:12.673634 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.673609 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:54:12.680027 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.680011 2560 scope.go:117] "RemoveContainer" containerID="4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893" Jul 07 13:54:12.686954 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.686934 2560 scope.go:117] "RemoveContainer" containerID="ea475f34f1051d5bb68404eeb4a08204f6ea769080646bc5bf4e49d21369b5d5" Jul 07 13:54:12.694448 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.694430 2560 scope.go:117] "RemoveContainer" containerID="b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25" Jul 07 13:54:12.694734 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:54:12.694711 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25\": container with ID starting with b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25 not found: ID does not exist" containerID="b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25" Jul 07 13:54:12.694793 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.694745 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25"} err="failed to get container status \"b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25\": rpc error: code = NotFound desc = could not find container \"b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25\": container with ID starting with b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25 not found: ID does not exist" Jul 07 13:54:12.694793 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.694766 2560 scope.go:117] "RemoveContainer" containerID="b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d" Jul 07 13:54:12.695008 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:54:12.694994 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d\": container with ID starting with b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d not found: ID does not exist" containerID="b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d" Jul 07 13:54:12.695044 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.695011 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d"} err="failed to get container status \"b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d\": rpc error: code = NotFound desc = could not find container \"b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d\": container with ID starting with b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d not found: ID does not exist" Jul 07 13:54:12.695044 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.695024 2560 scope.go:117] "RemoveContainer" containerID="bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e" Jul 07 13:54:12.695245 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:54:12.695229 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e\": container with ID starting with bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e not found: ID does not exist" containerID="bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e" Jul 07 13:54:12.695283 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.695248 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e"} err="failed to get container status \"bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e\": rpc error: code = NotFound desc = could not find container \"bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e\": container with ID starting with bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e not found: ID does not exist" Jul 07 13:54:12.695283 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.695262 2560 scope.go:117] "RemoveContainer" containerID="c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153" Jul 07 13:54:12.695441 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:54:12.695425 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153\": container with ID starting with c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153 not found: ID does not exist" containerID="c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153" Jul 07 13:54:12.695476 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.695444 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153"} err="failed to get container status \"c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153\": rpc error: code = NotFound desc = could not find container \"c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153\": container with ID starting with c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153 not found: ID does not exist" Jul 07 13:54:12.695476 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.695456 2560 scope.go:117] "RemoveContainer" containerID="66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7" Jul 07 13:54:12.695650 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:54:12.695634 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7\": container with ID starting with 66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7 not found: ID does not exist" containerID="66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7" Jul 07 13:54:12.695688 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.695654 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7"} err="failed to get container status \"66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7\": rpc error: code = NotFound desc = could not find container \"66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7\": container with ID starting with 66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7 not found: ID does not exist" Jul 07 13:54:12.695688 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.695667 2560 scope.go:117] "RemoveContainer" containerID="4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893" Jul 07 13:54:12.695866 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:54:12.695851 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893\": container with ID starting with 4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893 not found: ID does not exist" containerID="4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893" Jul 07 13:54:12.695908 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.695869 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893"} err="failed to get container status \"4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893\": rpc error: code = NotFound desc = could not find container \"4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893\": container with ID starting with 4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893 not found: ID does not exist" Jul 07 13:54:12.695908 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.695882 2560 scope.go:117] "RemoveContainer" containerID="ea475f34f1051d5bb68404eeb4a08204f6ea769080646bc5bf4e49d21369b5d5" Jul 07 13:54:12.696079 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:54:12.696062 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea475f34f1051d5bb68404eeb4a08204f6ea769080646bc5bf4e49d21369b5d5\": container with ID starting with ea475f34f1051d5bb68404eeb4a08204f6ea769080646bc5bf4e49d21369b5d5 not found: ID does not exist" containerID="ea475f34f1051d5bb68404eeb4a08204f6ea769080646bc5bf4e49d21369b5d5" Jul 07 13:54:12.696125 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.696085 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea475f34f1051d5bb68404eeb4a08204f6ea769080646bc5bf4e49d21369b5d5"} err="failed to get container status \"ea475f34f1051d5bb68404eeb4a08204f6ea769080646bc5bf4e49d21369b5d5\": rpc error: code = NotFound desc = could not find container \"ea475f34f1051d5bb68404eeb4a08204f6ea769080646bc5bf4e49d21369b5d5\": container with ID starting with ea475f34f1051d5bb68404eeb4a08204f6ea769080646bc5bf4e49d21369b5d5 not found: ID does not exist" Jul 07 13:54:12.696125 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.696101 2560 scope.go:117] "RemoveContainer" containerID="b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25" Jul 07 13:54:12.696278 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.696264 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25"} err="failed to get container status \"b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25\": rpc error: code = NotFound desc = could not find container \"b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25\": container with ID starting with b0890ab91e405dc59425ebf7fc82c51f284b76e1669edfa6601ec0514e42fb25 not found: ID does not exist" Jul 07 13:54:12.696321 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.696278 2560 scope.go:117] "RemoveContainer" containerID="b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d" Jul 07 13:54:12.696436 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.696419 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d"} err="failed to get container status \"b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d\": rpc error: code = NotFound desc = could not find container \"b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d\": container with ID starting with b5aa5657149918ab20e51e5cbc78cdf47f1daf190c63d2bb8cb61c6f2a6ec90d not found: ID does not exist" Jul 07 13:54:12.696479 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.696437 2560 scope.go:117] "RemoveContainer" containerID="bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e" Jul 07 13:54:12.696608 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.696592 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e"} err="failed to get container status \"bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e\": rpc error: code = NotFound desc = could not find container \"bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e\": container with ID starting with bbbd94d3ccf122bfb47fe86899bb1e61a32f07e3815595d7e7b53a96fdb7d24e not found: ID does not exist" Jul 07 13:54:12.696646 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.696609 2560 scope.go:117] "RemoveContainer" containerID="c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153" Jul 07 13:54:12.696799 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.696776 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153"} err="failed to get container status \"c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153\": rpc error: code = NotFound desc = could not find container \"c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153\": container with ID starting with c4604c03f20c3014aabfb6d1fe155834db62eb96bd40b7a140716b7d73408153 not found: ID does not exist" Jul 07 13:54:12.696799 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.696800 2560 scope.go:117] "RemoveContainer" containerID="66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7" Jul 07 13:54:12.697040 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.697024 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7"} err="failed to get container status \"66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7\": rpc error: code = NotFound desc = could not find container \"66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7\": container with ID starting with 66176bcce7222b274871c60bd5ea810f5bf679b717e0e03c2db8cc0665830ca7 not found: ID does not exist" Jul 07 13:54:12.697082 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.697040 2560 scope.go:117] "RemoveContainer" containerID="4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893" Jul 07 13:54:12.697244 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.697227 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893"} err="failed to get container status \"4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893\": rpc error: code = NotFound desc = could not find container \"4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893\": container with ID starting with 4c28288eff8f13f45a828c506b560653ef302b6232859d5334b4245e65fd0893 not found: ID does not exist" Jul 07 13:54:12.697297 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.697244 2560 scope.go:117] "RemoveContainer" containerID="ea475f34f1051d5bb68404eeb4a08204f6ea769080646bc5bf4e49d21369b5d5" Jul 07 13:54:12.697448 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.697426 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea475f34f1051d5bb68404eeb4a08204f6ea769080646bc5bf4e49d21369b5d5"} err="failed to get container status \"ea475f34f1051d5bb68404eeb4a08204f6ea769080646bc5bf4e49d21369b5d5\": rpc error: code = NotFound desc = could not find container \"ea475f34f1051d5bb68404eeb4a08204f6ea769080646bc5bf4e49d21369b5d5\": container with ID starting with ea475f34f1051d5bb68404eeb4a08204f6ea769080646bc5bf4e49d21369b5d5 not found: ID does not exist" Jul 07 13:54:12.710458 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.710421 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:54:12.711028 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.711009 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="kube-rbac-proxy-metric" Jul 07 13:54:12.711132 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.711123 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="kube-rbac-proxy-metric" Jul 07 13:54:12.711228 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.711220 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f" containerName="registry" Jul 07 13:54:12.711301 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.711293 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f" containerName="registry" Jul 07 13:54:12.711378 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.711370 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="alertmanager" Jul 07 13:54:12.711438 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.711431 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="alertmanager" Jul 07 13:54:12.711502 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.711494 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="kube-rbac-proxy-web" Jul 07 13:54:12.711564 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.711556 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="kube-rbac-proxy-web" Jul 07 13:54:12.711632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.711624 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="418d998f-1b7d-4a62-8152-c70fa78a6598" containerName="console" Jul 07 13:54:12.711691 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.711682 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="418d998f-1b7d-4a62-8152-c70fa78a6598" containerName="console" Jul 07 13:54:12.711756 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.711749 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="init-config-reloader" Jul 07 13:54:12.711820 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.711812 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="init-config-reloader" Jul 07 13:54:12.711907 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.711897 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="prom-label-proxy" Jul 07 13:54:12.711965 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.711958 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="prom-label-proxy" Jul 07 13:54:12.712035 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.712027 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="config-reloader" Jul 07 13:54:12.712092 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.712085 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="config-reloader" Jul 07 13:54:12.712209 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.712200 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="kube-rbac-proxy" Jul 07 13:54:12.712268 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.712260 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="kube-rbac-proxy" Jul 07 13:54:12.712406 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.712397 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="69c2dca2-474c-445f-8c6a-bd3f0c8c1e4f" containerName="registry" Jul 07 13:54:12.712473 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.712466 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="prom-label-proxy" Jul 07 13:54:12.712535 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.712527 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="config-reloader" Jul 07 13:54:12.712594 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.712586 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="kube-rbac-proxy-web" Jul 07 13:54:12.712659 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.712651 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="418d998f-1b7d-4a62-8152-c70fa78a6598" containerName="console" Jul 07 13:54:12.712722 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.712714 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="kube-rbac-proxy" Jul 07 13:54:12.712781 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.712773 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="kube-rbac-proxy-metric" Jul 07 13:54:12.712862 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.712853 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" containerName="alertmanager" Jul 07 13:54:12.713937 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.713910 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-main-tls\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:12.713937 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.713935 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-tls-assets\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:12.714086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.713950 2560 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-cluster-tls-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:12.714086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.713965 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:12.714086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.713979 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-config-out\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:12.714086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.713993 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:12.714086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.714006 2560 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-config-volume\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:12.714086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.714022 2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:12.714086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.714034 2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-alertmanager-main-db\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:12.714086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.714046 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:12.714086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.714059 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-web-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:12.714086 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.714071 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64vxz\" (UniqueName: \"kubernetes.io/projected/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b-kube-api-access-64vxz\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:12.717376 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.717361 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.720180 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.720162 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 13:54:12.720318 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.720300 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nrjd8\"" Jul 07 13:54:12.720318 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.720313 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 13:54:12.720466 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.720372 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 13:54:12.720466 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.720401 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 13:54:12.720466 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.720416 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 13:54:12.720601 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.720476 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 13:54:12.720958 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.720943 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 13:54:12.721032 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.720967 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 13:54:12.727110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.727090 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 13:54:12.732005 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.731985 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:54:12.815178 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.815148 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-web-config\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.815178 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.815177 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.815370 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.815221 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.815370 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.815251 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45db34c1-3b3c-4dac-90e7-3cec563da300-tls-assets\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.815370 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.815267 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-config-volume\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.815370 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.815291 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45db34c1-3b3c-4dac-90e7-3cec563da300-config-out\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.815370 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.815306 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.815370 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.815322 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45db34c1-3b3c-4dac-90e7-3cec563da300-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.815370 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.815340 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45db34c1-3b3c-4dac-90e7-3cec563da300-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.815370 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.815359 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.815595 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.815381 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jk8v\" (UniqueName: \"kubernetes.io/projected/45db34c1-3b3c-4dac-90e7-3cec563da300-kube-api-access-5jk8v\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.815595 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.815448 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.815595 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.815475 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45db34c1-3b3c-4dac-90e7-3cec563da300-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.916816 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.916725 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-web-config\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.916816 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.916764 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.916816 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.916806 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.917201 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.916852 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45db34c1-3b3c-4dac-90e7-3cec563da300-tls-assets\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.917201 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.916881 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-config-volume\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.917201 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.916909 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45db34c1-3b3c-4dac-90e7-3cec563da300-config-out\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.917201 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.916931 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.917201 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.916957 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45db34c1-3b3c-4dac-90e7-3cec563da300-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.917201 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.916986 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45db34c1-3b3c-4dac-90e7-3cec563da300-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.917201 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.917007 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.917201 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.917047 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jk8v\" (UniqueName: \"kubernetes.io/projected/45db34c1-3b3c-4dac-90e7-3cec563da300-kube-api-access-5jk8v\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.917201 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.917083 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.917201 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.917105 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45db34c1-3b3c-4dac-90e7-3cec563da300-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.918173 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.917844 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45db34c1-3b3c-4dac-90e7-3cec563da300-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.918173 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.917883 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45db34c1-3b3c-4dac-90e7-3cec563da300-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.918173 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.918022 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45db34c1-3b3c-4dac-90e7-3cec563da300-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.920048 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.920020 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45db34c1-3b3c-4dac-90e7-3cec563da300-config-out\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.920640 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.920535 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.920764 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.920656 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.920817 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.920781 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-web-config\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.920890 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.920816 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45db34c1-3b3c-4dac-90e7-3cec563da300-tls-assets\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.920890 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.920824 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.925323 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.921317 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-config-volume\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.925323 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.921704 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.925708 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.925687 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45db34c1-3b3c-4dac-90e7-3cec563da300-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:12.927076 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:12.927056 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jk8v\" (UniqueName: \"kubernetes.io/projected/45db34c1-3b3c-4dac-90e7-3cec563da300-kube-api-access-5jk8v\") pod \"alertmanager-main-0\" (UID: \"45db34c1-3b3c-4dac-90e7-3cec563da300\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:13.027563 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:13.027527 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:54:13.161109 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:13.161085 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:54:13.163148 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:54:13.163124 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45db34c1_3b3c_4dac_90e7_3cec563da300.slice/crio-c79a68af66bf686d29bc64ccf95691a386a910e8449d7dd7bf78d63bcd5efc20 WatchSource:0}: Error finding container c79a68af66bf686d29bc64ccf95691a386a910e8449d7dd7bf78d63bcd5efc20: Status 404 returned error can't find the container with id c79a68af66bf686d29bc64ccf95691a386a910e8449d7dd7bf78d63bcd5efc20 Jul 07 13:54:13.648028 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:13.647994 2560 generic.go:356] "Generic (PLEG): container finished" podID="45db34c1-3b3c-4dac-90e7-3cec563da300" containerID="05b6f645f154c36f55d459de4762956663aaae6752cfbc2426066bd59821036b" exitCode=0 Jul 07 13:54:13.648407 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:13.648084 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45db34c1-3b3c-4dac-90e7-3cec563da300","Type":"ContainerDied","Data":"05b6f645f154c36f55d459de4762956663aaae6752cfbc2426066bd59821036b"} Jul 07 13:54:13.648407 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:13.648154 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45db34c1-3b3c-4dac-90e7-3cec563da300","Type":"ContainerStarted","Data":"c79a68af66bf686d29bc64ccf95691a386a910e8449d7dd7bf78d63bcd5efc20"} Jul 07 13:54:13.734427 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:13.734388 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b844b09-21d8-49e3-8fcf-10f7a6e36e9b" path="/var/lib/kubelet/pods/3b844b09-21d8-49e3-8fcf-10f7a6e36e9b/volumes" Jul 07 13:54:14.655470 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:14.655436 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45db34c1-3b3c-4dac-90e7-3cec563da300","Type":"ContainerStarted","Data":"610bf023066466e589d3be16025dc655455b16a7d01a62bb9ec2f31c02d20b56"} Jul 07 13:54:14.655824 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:14.655515 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45db34c1-3b3c-4dac-90e7-3cec563da300","Type":"ContainerStarted","Data":"836f587ad0ae1b7949b2d75ac9324d2087017a10b0b2b6ef8eb54e9f3a63789f"} Jul 07 13:54:14.655824 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:14.655555 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45db34c1-3b3c-4dac-90e7-3cec563da300","Type":"ContainerStarted","Data":"d167bba7a8dec9a116e34e8cd9149ced8707cdc29edb776a65e1d9d7fe811135"} Jul 07 13:54:14.655824 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:14.655594 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45db34c1-3b3c-4dac-90e7-3cec563da300","Type":"ContainerStarted","Data":"f719fd443c4d333002d8070602b364af5749fa9c72ff6ef08005ef88e5c493e1"} Jul 07 13:54:14.655824 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:14.655629 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45db34c1-3b3c-4dac-90e7-3cec563da300","Type":"ContainerStarted","Data":"33e168abc2b515aa4a937d7d8a3855a1c42c1ae08777b02fa8127c3e253ade2b"} Jul 07 13:54:14.655824 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:14.655664 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45db34c1-3b3c-4dac-90e7-3cec563da300","Type":"ContainerStarted","Data":"416e3cae8485b15189fdf83f74a3125dd6a51a10df381fe415116330f91d9f3e"} Jul 07 13:54:14.687286 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:14.687227 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.668646465 podStartE2EDuration="2.687204855s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.55839ms" isStatefulPod=false podCreationTimestamp="2026-07-07 13:54:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:54:14.685152506 +0000 UTC m=+201.550356971" watchObservedRunningTime="2026-07-07 13:54:14.687204855 +0000 UTC m=+201.552409321" Jul 07 13:54:15.553615 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.553581 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 13:54:15.553948 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.553897 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="prometheus" containerID="cri-o://79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb" gracePeriod=600 Jul 07 13:54:15.554045 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.553932 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="kube-rbac-proxy-web" containerID="cri-o://33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1" gracePeriod=600 Jul 07 13:54:15.554045 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.553912 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="thanos-sidecar" containerID="cri-o://701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9" gracePeriod=600 Jul 07 13:54:15.554045 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.553920 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7" gracePeriod=600 Jul 07 13:54:15.554196 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.553949 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="config-reloader" containerID="cri-o://f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403" gracePeriod=600 Jul 07 13:54:15.554196 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.553905 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="kube-rbac-proxy" containerID="cri-o://b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8" gracePeriod=600 Jul 07 13:54:15.811960 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.811904 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:15.942723 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.942685 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-metrics-client-certs\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.942723 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.942726 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-tls\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943015 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.942757 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-serving-certs-ca-bundle\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943015 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.942782 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/602d86b6-fccb-4577-9ca1-1892c686cfc0-config-out\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943015 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.942805 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-kube-rbac-proxy\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943015 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.942909 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-kubelet-serving-ca-bundle\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943015 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.942957 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-web-config\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943015 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.942981 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-trusted-ca-bundle\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943015 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943018 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-1\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943346 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943054 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-grpc-tls\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943346 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943105 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-thanos-prometheus-http-client-file\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943346 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943154 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pct6r\" (UniqueName: \"kubernetes.io/projected/602d86b6-fccb-4577-9ca1-1892c686cfc0-kube-api-access-pct6r\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943346 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943181 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:54:15.943346 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943199 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-0\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943346 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943227 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943346 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943252 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-db\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943346 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943284 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-config\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943346 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943308 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943346 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943334 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-2\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943810 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943366 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/602d86b6-fccb-4577-9ca1-1892c686cfc0-tls-assets\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943810 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943415 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-metrics-client-ca\") pod \"602d86b6-fccb-4577-9ca1-1892c686cfc0\" (UID: \"602d86b6-fccb-4577-9ca1-1892c686cfc0\") " Jul 07 13:54:15.943810 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943471 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:54:15.943810 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943502 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:54:15.944032 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943858 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:54:15.944032 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943876 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:15.944032 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943898 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:15.944032 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.943913 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:15.946284 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.945715 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:54:15.946284 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.945796 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:54:15.946284 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.945893 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:15.946284 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.946081 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602d86b6-fccb-4577-9ca1-1892c686cfc0-config-out" (OuterVolumeSpecName: "config-out") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:54:15.946284 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.946111 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:15.946284 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.946174 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:15.946284 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.946251 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:54:15.946722 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.946371 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:15.947355 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.947316 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:54:15.947456 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.947373 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:15.947747 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.947715 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-config" (OuterVolumeSpecName: "config") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:15.947863 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.947805 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:15.948196 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.948178 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:15.948287 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.948271 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/602d86b6-fccb-4577-9ca1-1892c686cfc0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:54:15.948376 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.948361 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/602d86b6-fccb-4577-9ca1-1892c686cfc0-kube-api-access-pct6r" (OuterVolumeSpecName: "kube-api-access-pct6r") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "kube-api-access-pct6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:54:15.956746 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:15.956725 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-web-config" (OuterVolumeSpecName: "web-config") pod "602d86b6-fccb-4577-9ca1-1892c686cfc0" (UID: "602d86b6-fccb-4577-9ca1-1892c686cfc0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:16.045278 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.045235 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/602d86b6-fccb-4577-9ca1-1892c686cfc0-config-out\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:16.045278 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.045275 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-kube-rbac-proxy\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:16.045278 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.045286 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-web-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:16.045278 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.045297 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:16.045545 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.045307 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-grpc-tls\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:16.045545 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.045316 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:16.045545 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.045324 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pct6r\" (UniqueName: \"kubernetes.io/projected/602d86b6-fccb-4577-9ca1-1892c686cfc0-kube-api-access-pct6r\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:16.045545 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.045332 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:16.045545 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.045341 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:16.045545 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.045349 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-db\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:16.045545 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.045357 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:16.045545 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.045365 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:16.045545 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.045373 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:16.045545 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.045382 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/602d86b6-fccb-4577-9ca1-1892c686cfc0-tls-assets\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:16.045545 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.045389 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/602d86b6-fccb-4577-9ca1-1892c686cfc0-configmap-metrics-client-ca\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:16.045545 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.045397 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-metrics-client-certs\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:16.045545 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.045404 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/602d86b6-fccb-4577-9ca1-1892c686cfc0-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:16.668561 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.668528 2560 generic.go:356] "Generic (PLEG): container finished" podID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerID="ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7" exitCode=0 Jul 07 13:54:16.668561 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.668553 2560 generic.go:356] "Generic (PLEG): container finished" podID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerID="b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8" exitCode=0 Jul 07 13:54:16.668561 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.668559 2560 generic.go:356] "Generic (PLEG): container finished" podID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerID="33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1" exitCode=0 Jul 07 13:54:16.668561 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.668564 2560 generic.go:356] "Generic (PLEG): container finished" podID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerID="701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9" exitCode=0 Jul 07 13:54:16.668561 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.668569 2560 generic.go:356] "Generic (PLEG): container finished" podID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerID="f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403" exitCode=0 Jul 07 13:54:16.668872 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.668574 2560 generic.go:356] "Generic (PLEG): container finished" podID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerID="79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb" exitCode=0 Jul 07 13:54:16.668872 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.668608 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.668872 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.668603 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"602d86b6-fccb-4577-9ca1-1892c686cfc0","Type":"ContainerDied","Data":"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7"} Jul 07 13:54:16.668872 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.668735 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"602d86b6-fccb-4577-9ca1-1892c686cfc0","Type":"ContainerDied","Data":"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8"} Jul 07 13:54:16.668872 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.668791 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"602d86b6-fccb-4577-9ca1-1892c686cfc0","Type":"ContainerDied","Data":"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1"} Jul 07 13:54:16.668872 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.668799 2560 scope.go:117] "RemoveContainer" containerID="ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7" Jul 07 13:54:16.668872 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.668817 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"602d86b6-fccb-4577-9ca1-1892c686cfc0","Type":"ContainerDied","Data":"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9"} Jul 07 13:54:16.668872 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.668860 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"602d86b6-fccb-4577-9ca1-1892c686cfc0","Type":"ContainerDied","Data":"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403"} Jul 07 13:54:16.669213 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.668888 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"602d86b6-fccb-4577-9ca1-1892c686cfc0","Type":"ContainerDied","Data":"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb"} Jul 07 13:54:16.669213 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.668911 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"602d86b6-fccb-4577-9ca1-1892c686cfc0","Type":"ContainerDied","Data":"fbe7232c09cb2f0f68c6b9fa571c20566c5a5fe1382a5989d2fdfeb10240ede3"} Jul 07 13:54:16.676967 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.676950 2560 scope.go:117] "RemoveContainer" containerID="b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8" Jul 07 13:54:16.683957 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.683942 2560 scope.go:117] "RemoveContainer" containerID="33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1" Jul 07 13:54:16.691105 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.691075 2560 scope.go:117] "RemoveContainer" containerID="701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9" Jul 07 13:54:16.692565 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.692543 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 13:54:16.697599 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.697577 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 13:54:16.699460 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.699440 2560 scope.go:117] "RemoveContainer" containerID="f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403" Jul 07 13:54:16.706433 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.706416 2560 scope.go:117] "RemoveContainer" containerID="79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb" Jul 07 13:54:16.713820 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.713802 2560 scope.go:117] "RemoveContainer" containerID="737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61" Jul 07 13:54:16.720748 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.720727 2560 scope.go:117] "RemoveContainer" containerID="ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7" Jul 07 13:54:16.721008 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:54:16.720991 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7\": container with ID starting with ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7 not found: ID does not exist" containerID="ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7" Jul 07 13:54:16.721058 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.721017 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7"} err="failed to get container status \"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7\": rpc error: code = NotFound desc = could not find container \"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7\": container with ID starting with ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7 not found: ID does not exist" Jul 07 13:54:16.721058 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.721036 2560 scope.go:117] "RemoveContainer" containerID="b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8" Jul 07 13:54:16.721260 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:54:16.721245 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8\": container with ID starting with b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8 not found: ID does not exist" containerID="b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8" Jul 07 13:54:16.721303 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.721269 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8"} err="failed to get container status \"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8\": rpc error: code = NotFound desc = could not find container \"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8\": container with ID starting with b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8 not found: ID does not exist" Jul 07 13:54:16.721303 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.721284 2560 scope.go:117] "RemoveContainer" containerID="33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1" Jul 07 13:54:16.721604 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:54:16.721587 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1\": container with ID starting with 33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1 not found: ID does not exist" containerID="33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1" Jul 07 13:54:16.721649 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.721607 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1"} err="failed to get container status \"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1\": rpc error: code = NotFound desc = could not find container \"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1\": container with ID starting with 33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1 not found: ID does not exist" Jul 07 13:54:16.721649 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.721622 2560 scope.go:117] "RemoveContainer" containerID="701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9" Jul 07 13:54:16.721857 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:54:16.721824 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9\": container with ID starting with 701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9 not found: ID does not exist" containerID="701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9" Jul 07 13:54:16.721938 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.721860 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9"} err="failed to get container status \"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9\": rpc error: code = NotFound desc = could not find container \"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9\": container with ID starting with 701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9 not found: ID does not exist" Jul 07 13:54:16.721938 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.721874 2560 scope.go:117] "RemoveContainer" containerID="f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403" Jul 07 13:54:16.722133 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:54:16.722099 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403\": container with ID starting with f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403 not found: ID does not exist" containerID="f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403" Jul 07 13:54:16.722184 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.722129 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403"} err="failed to get container status \"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403\": rpc error: code = NotFound desc = could not find container \"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403\": container with ID starting with f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403 not found: ID does not exist" Jul 07 13:54:16.722184 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.722148 2560 scope.go:117] "RemoveContainer" containerID="79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb" Jul 07 13:54:16.722534 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:54:16.722509 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb\": container with ID starting with 79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb not found: ID does not exist" containerID="79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb" Jul 07 13:54:16.722622 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.722543 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb"} err="failed to get container status \"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb\": rpc error: code = NotFound desc = could not find container \"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb\": container with ID starting with 79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb not found: ID does not exist" Jul 07 13:54:16.722622 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.722565 2560 scope.go:117] "RemoveContainer" containerID="737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61" Jul 07 13:54:16.722938 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:54:16.722904 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61\": container with ID starting with 737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61 not found: ID does not exist" containerID="737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61" Jul 07 13:54:16.723024 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.722944 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61"} err="failed to get container status \"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61\": rpc error: code = NotFound desc = could not find container \"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61\": container with ID starting with 737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61 not found: ID does not exist" Jul 07 13:54:16.723024 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.722971 2560 scope.go:117] "RemoveContainer" containerID="ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7" Jul 07 13:54:16.723386 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.723360 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7"} err="failed to get container status \"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7\": rpc error: code = NotFound desc = could not find container \"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7\": container with ID starting with ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7 not found: ID does not exist" Jul 07 13:54:16.723386 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.723386 2560 scope.go:117] "RemoveContainer" containerID="b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8" Jul 07 13:54:16.723680 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.723660 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8"} err="failed to get container status \"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8\": rpc error: code = NotFound desc = could not find container \"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8\": container with ID starting with b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8 not found: ID does not exist" Jul 07 13:54:16.723737 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.723680 2560 scope.go:117] "RemoveContainer" containerID="33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1" Jul 07 13:54:16.723944 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.723921 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1"} err="failed to get container status \"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1\": rpc error: code = NotFound desc = could not find container \"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1\": container with ID starting with 33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1 not found: ID does not exist" Jul 07 13:54:16.724019 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.723945 2560 scope.go:117] "RemoveContainer" containerID="701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9" Jul 07 13:54:16.724205 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.724189 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9"} err="failed to get container status \"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9\": rpc error: code = NotFound desc = could not find container \"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9\": container with ID starting with 701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9 not found: ID does not exist" Jul 07 13:54:16.724265 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.724206 2560 scope.go:117] "RemoveContainer" containerID="f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403" Jul 07 13:54:16.724428 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.724411 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403"} err="failed to get container status \"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403\": rpc error: code = NotFound desc = could not find container \"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403\": container with ID starting with f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403 not found: ID does not exist" Jul 07 13:54:16.724485 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.724430 2560 scope.go:117] "RemoveContainer" containerID="79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb" Jul 07 13:54:16.724485 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.724420 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 13:54:16.724668 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.724650 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb"} err="failed to get container status \"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb\": rpc error: code = NotFound desc = could not find container \"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb\": container with ID starting with 79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb not found: ID does not exist" Jul 07 13:54:16.724723 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.724668 2560 scope.go:117] "RemoveContainer" containerID="737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61" Jul 07 13:54:16.724874 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.724859 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="kube-rbac-proxy-thanos" Jul 07 13:54:16.724929 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.724877 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="kube-rbac-proxy-thanos" Jul 07 13:54:16.724929 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.724888 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="thanos-sidecar" Jul 07 13:54:16.724929 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.724896 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="thanos-sidecar" Jul 07 13:54:16.724929 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.724898 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61"} err="failed to get container status \"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61\": rpc error: code = NotFound desc = could not find container \"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61\": container with ID starting with 737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61 not found: ID does not exist" Jul 07 13:54:16.724929 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.724926 2560 scope.go:117] "RemoveContainer" containerID="ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7" Jul 07 13:54:16.725089 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.724912 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="kube-rbac-proxy" Jul 07 13:54:16.725089 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.724978 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="kube-rbac-proxy" Jul 07 13:54:16.725089 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.724994 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="init-config-reloader" Jul 07 13:54:16.725089 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725000 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="init-config-reloader" Jul 07 13:54:16.725089 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725015 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="kube-rbac-proxy-web" Jul 07 13:54:16.725089 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725020 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="kube-rbac-proxy-web" Jul 07 13:54:16.725089 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725030 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="config-reloader" Jul 07 13:54:16.725089 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725037 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="config-reloader" Jul 07 13:54:16.725089 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725053 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="prometheus" Jul 07 13:54:16.725089 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725061 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="prometheus" Jul 07 13:54:16.725364 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725166 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="kube-rbac-proxy-web" Jul 07 13:54:16.725364 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725176 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="thanos-sidecar" Jul 07 13:54:16.725364 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725181 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="kube-rbac-proxy-thanos" Jul 07 13:54:16.725364 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725176 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7"} err="failed to get container status \"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7\": rpc error: code = NotFound desc = could not find container \"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7\": container with ID starting with ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7 not found: ID does not exist" Jul 07 13:54:16.725364 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725193 2560 scope.go:117] "RemoveContainer" containerID="b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8" Jul 07 13:54:16.725364 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725186 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="prometheus" Jul 07 13:54:16.725364 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725254 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="config-reloader" Jul 07 13:54:16.725364 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725263 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" containerName="kube-rbac-proxy" Jul 07 13:54:16.725645 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725407 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8"} err="failed to get container status \"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8\": rpc error: code = NotFound desc = could not find container \"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8\": container with ID starting with b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8 not found: ID does not exist" Jul 07 13:54:16.725645 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725425 2560 scope.go:117] "RemoveContainer" containerID="33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1" Jul 07 13:54:16.725705 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725657 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1"} err="failed to get container status \"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1\": rpc error: code = NotFound desc = could not find container \"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1\": container with ID starting with 33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1 not found: ID does not exist" Jul 07 13:54:16.725705 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725670 2560 scope.go:117] "RemoveContainer" containerID="701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9" Jul 07 13:54:16.725948 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725920 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9"} err="failed to get container status \"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9\": rpc error: code = NotFound desc = could not find container \"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9\": container with ID starting with 701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9 not found: ID does not exist" Jul 07 13:54:16.725948 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.725949 2560 scope.go:117] "RemoveContainer" containerID="f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403" Jul 07 13:54:16.726221 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.726203 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403"} err="failed to get container status \"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403\": rpc error: code = NotFound desc = could not find container \"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403\": container with ID starting with f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403 not found: ID does not exist" Jul 07 13:54:16.726271 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.726222 2560 scope.go:117] "RemoveContainer" containerID="79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb" Jul 07 13:54:16.726448 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.726431 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb"} err="failed to get container status \"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb\": rpc error: code = NotFound desc = could not find container \"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb\": container with ID starting with 79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb not found: ID does not exist" Jul 07 13:54:16.726494 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.726449 2560 scope.go:117] "RemoveContainer" containerID="737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61" Jul 07 13:54:16.726669 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.726652 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61"} err="failed to get container status \"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61\": rpc error: code = NotFound desc = could not find container \"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61\": container with ID starting with 737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61 not found: ID does not exist" Jul 07 13:54:16.726727 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.726671 2560 scope.go:117] "RemoveContainer" containerID="ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7" Jul 07 13:54:16.726911 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.726893 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7"} err="failed to get container status \"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7\": rpc error: code = NotFound desc = could not find container \"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7\": container with ID starting with ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7 not found: ID does not exist" Jul 07 13:54:16.726959 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.726912 2560 scope.go:117] "RemoveContainer" containerID="b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8" Jul 07 13:54:16.727133 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.727117 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8"} err="failed to get container status \"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8\": rpc error: code = NotFound desc = could not find container \"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8\": container with ID starting with b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8 not found: ID does not exist" Jul 07 13:54:16.727172 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.727135 2560 scope.go:117] "RemoveContainer" containerID="33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1" Jul 07 13:54:16.727326 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.727308 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1"} err="failed to get container status \"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1\": rpc error: code = NotFound desc = could not find container \"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1\": container with ID starting with 33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1 not found: ID does not exist" Jul 07 13:54:16.727326 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.727325 2560 scope.go:117] "RemoveContainer" containerID="701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9" Jul 07 13:54:16.727510 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.727492 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9"} err="failed to get container status \"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9\": rpc error: code = NotFound desc = could not find container \"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9\": container with ID starting with 701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9 not found: ID does not exist" Jul 07 13:54:16.727581 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.727512 2560 scope.go:117] "RemoveContainer" containerID="f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403" Jul 07 13:54:16.727741 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.727725 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403"} err="failed to get container status \"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403\": rpc error: code = NotFound desc = could not find container \"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403\": container with ID starting with f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403 not found: ID does not exist" Jul 07 13:54:16.727782 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.727741 2560 scope.go:117] "RemoveContainer" containerID="79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb" Jul 07 13:54:16.727966 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.727947 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb"} err="failed to get container status \"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb\": rpc error: code = NotFound desc = could not find container \"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb\": container with ID starting with 79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb not found: ID does not exist" Jul 07 13:54:16.728022 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.727967 2560 scope.go:117] "RemoveContainer" containerID="737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61" Jul 07 13:54:16.728158 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.728143 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61"} err="failed to get container status \"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61\": rpc error: code = NotFound desc = could not find container \"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61\": container with ID starting with 737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61 not found: ID does not exist" Jul 07 13:54:16.728209 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.728158 2560 scope.go:117] "RemoveContainer" containerID="ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7" Jul 07 13:54:16.728361 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.728346 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7"} err="failed to get container status \"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7\": rpc error: code = NotFound desc = could not find container \"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7\": container with ID starting with ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7 not found: ID does not exist" Jul 07 13:54:16.728361 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.728360 2560 scope.go:117] "RemoveContainer" containerID="b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8" Jul 07 13:54:16.728538 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.728519 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8"} err="failed to get container status \"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8\": rpc error: code = NotFound desc = could not find container \"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8\": container with ID starting with b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8 not found: ID does not exist" Jul 07 13:54:16.728577 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.728538 2560 scope.go:117] "RemoveContainer" containerID="33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1" Jul 07 13:54:16.728750 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.728735 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1"} err="failed to get container status \"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1\": rpc error: code = NotFound desc = could not find container \"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1\": container with ID starting with 33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1 not found: ID does not exist" Jul 07 13:54:16.728804 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.728750 2560 scope.go:117] "RemoveContainer" containerID="701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9" Jul 07 13:54:16.729006 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.728989 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9"} err="failed to get container status \"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9\": rpc error: code = NotFound desc = could not find container \"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9\": container with ID starting with 701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9 not found: ID does not exist" Jul 07 13:54:16.729054 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.729007 2560 scope.go:117] "RemoveContainer" containerID="f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403" Jul 07 13:54:16.729228 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.729212 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403"} err="failed to get container status \"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403\": rpc error: code = NotFound desc = could not find container \"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403\": container with ID starting with f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403 not found: ID does not exist" Jul 07 13:54:16.729270 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.729229 2560 scope.go:117] "RemoveContainer" containerID="79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb" Jul 07 13:54:16.729444 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.729419 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb"} err="failed to get container status \"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb\": rpc error: code = NotFound desc = could not find container \"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb\": container with ID starting with 79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb not found: ID does not exist" Jul 07 13:54:16.729497 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.729444 2560 scope.go:117] "RemoveContainer" containerID="737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61" Jul 07 13:54:16.729587 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.729574 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.729650 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.729635 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61"} err="failed to get container status \"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61\": rpc error: code = NotFound desc = could not find container \"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61\": container with ID starting with 737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61 not found: ID does not exist" Jul 07 13:54:16.729691 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.729651 2560 scope.go:117] "RemoveContainer" containerID="ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7" Jul 07 13:54:16.729923 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.729895 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7"} err="failed to get container status \"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7\": rpc error: code = NotFound desc = could not find container \"ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7\": container with ID starting with ab4d4a9ee76c1d6dd0a154d46223d540381a2d5dd1296673bc2c3ffe7e9e07c7 not found: ID does not exist" Jul 07 13:54:16.729923 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.729923 2560 scope.go:117] "RemoveContainer" containerID="b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8" Jul 07 13:54:16.730217 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.730177 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8"} err="failed to get container status \"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8\": rpc error: code = NotFound desc = could not find container \"b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8\": container with ID starting with b5bca64bd10945f3b3828ab4640f6af308069af069a2372ba9e8d99873ba4ac8 not found: ID does not exist" Jul 07 13:54:16.730217 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.730200 2560 scope.go:117] "RemoveContainer" containerID="33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1" Jul 07 13:54:16.730463 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.730441 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1"} err="failed to get container status \"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1\": rpc error: code = NotFound desc = could not find container \"33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1\": container with ID starting with 33db58998c46f95b8a357155f54babd5db02f34973c2f927b69074464e92f3b1 not found: ID does not exist" Jul 07 13:54:16.730534 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.730465 2560 scope.go:117] "RemoveContainer" containerID="701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9" Jul 07 13:54:16.730724 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.730699 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9"} err="failed to get container status \"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9\": rpc error: code = NotFound desc = could not find container \"701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9\": container with ID starting with 701226ad3129a26cfc219ba30360a34a4117c303d3bad361250096d4415526c9 not found: ID does not exist" Jul 07 13:54:16.730787 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.730724 2560 scope.go:117] "RemoveContainer" containerID="f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403" Jul 07 13:54:16.730941 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.730923 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403"} err="failed to get container status \"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403\": rpc error: code = NotFound desc = could not find container \"f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403\": container with ID starting with f6d271be05d4f2f6b385968fbdb9177056df05c056f9446fe25b8f0058a98403 not found: ID does not exist" Jul 07 13:54:16.731000 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.730942 2560 scope.go:117] "RemoveContainer" containerID="79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb" Jul 07 13:54:16.731196 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.731178 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb"} err="failed to get container status \"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb\": rpc error: code = NotFound desc = could not find container \"79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb\": container with ID starting with 79c735aff0b38bb2bf683ed327297392f8c2a718cd1d546a3553d376b87277fb not found: ID does not exist" Jul 07 13:54:16.731234 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.731198 2560 scope.go:117] "RemoveContainer" containerID="737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61" Jul 07 13:54:16.731448 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.731432 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61"} err="failed to get container status \"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61\": rpc error: code = NotFound desc = could not find container \"737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61\": container with ID starting with 737240ceb635b65fbe0f9e186aebf9676c065f3155a2b1ae16bfb2c04a0bcc61 not found: ID does not exist" Jul 07 13:54:16.731797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.731785 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 13:54:16.732046 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.732027 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 13:54:16.732680 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.732664 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 13:54:16.732918 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.732900 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 13:54:16.733013 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.732942 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 13:54:16.733013 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.732986 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 13:54:16.733116 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.733026 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 13:54:16.733278 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.733264 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 13:54:16.733326 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.733296 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 13:54:16.733376 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.733348 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 13:54:16.733376 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.733364 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 13:54:16.733611 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.733595 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b3gvkd902emo8\"" Jul 07 13:54:16.733660 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.733625 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-thr8r\"" Jul 07 13:54:16.733699 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.733689 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 13:54:16.735940 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.735921 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 13:54:16.740339 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.740320 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 13:54:16.745731 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.745707 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 13:54:16.752343 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.752316 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.752448 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.752356 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.752448 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.752383 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.752559 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.752462 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.752559 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.752541 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.752681 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.752585 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06101efc-a19a-4546-961c-4c8c6046b9ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.752681 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.752627 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-config\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.752771 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.752719 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.752771 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.752759 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.752864 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.752821 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.752897 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.752874 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.752932 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.752917 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.752963 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.752949 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.753003 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.752984 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.753040 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.753012 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.753040 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.753033 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06101efc-a19a-4546-961c-4c8c6046b9ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854011 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.853909 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854011 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.853964 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854011 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.853992 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854011 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854013 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854030 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854072 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06101efc-a19a-4546-961c-4c8c6046b9ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854099 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854140 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-config\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854165 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854190 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854225 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854252 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854301 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854338 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854364 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8px4\" (UniqueName: \"kubernetes.io/projected/06101efc-a19a-4546-961c-4c8c6046b9ef-kube-api-access-l8px4\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854390 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854421 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854450 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854476 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06101efc-a19a-4546-961c-4c8c6046b9ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.854632 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854507 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06101efc-a19a-4546-961c-4c8c6046b9ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.855413 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854700 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.855413 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.854706 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.855413 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.855254 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.855933 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.855908 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.856994 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.856968 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06101efc-a19a-4546-961c-4c8c6046b9ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.857085 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.857057 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-config\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.857085 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.857064 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.857250 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.857222 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.857414 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.857390 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.857954 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.857891 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.858661 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.858635 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.858885 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.858863 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.859192 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.859171 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06101efc-a19a-4546-961c-4c8c6046b9ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.859468 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.859448 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.859534 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.859518 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.859968 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.859953 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.955454 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.955415 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.955640 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.955482 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8px4\" (UniqueName: \"kubernetes.io/projected/06101efc-a19a-4546-961c-4c8c6046b9ef-kube-api-access-l8px4\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.955640 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.955498 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.955640 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.955519 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06101efc-a19a-4546-961c-4c8c6046b9ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.955796 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.955782 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06101efc-a19a-4546-961c-4c8c6046b9ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.956256 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.956235 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06101efc-a19a-4546-961c-4c8c6046b9ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.957747 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.957730 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06101efc-a19a-4546-961c-4c8c6046b9ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:16.964434 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:16.964412 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8px4\" (UniqueName: \"kubernetes.io/projected/06101efc-a19a-4546-961c-4c8c6046b9ef-kube-api-access-l8px4\") pod \"prometheus-k8s-0\" (UID: \"06101efc-a19a-4546-961c-4c8c6046b9ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:17.039577 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:17.039542 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:17.179340 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:17.179301 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 13:54:17.183729 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:54:17.183704 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06101efc_a19a_4546_961c_4c8c6046b9ef.slice/crio-3359893a03846a19b3697f9d0b37b91bac3b2574c8839c1b444630f05c99b00d WatchSource:0}: Error finding container 3359893a03846a19b3697f9d0b37b91bac3b2574c8839c1b444630f05c99b00d: Status 404 returned error can't find the container with id 3359893a03846a19b3697f9d0b37b91bac3b2574c8839c1b444630f05c99b00d Jul 07 13:54:17.675110 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:17.675077 2560 generic.go:356] "Generic (PLEG): container finished" podID="06101efc-a19a-4546-961c-4c8c6046b9ef" containerID="943531bf1ce960786c621c480d04d935551fe1d24504c34060c93003efcd4664" exitCode=0 Jul 07 13:54:17.675285 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:17.675166 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06101efc-a19a-4546-961c-4c8c6046b9ef","Type":"ContainerDied","Data":"943531bf1ce960786c621c480d04d935551fe1d24504c34060c93003efcd4664"} Jul 07 13:54:17.675285 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:17.675230 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06101efc-a19a-4546-961c-4c8c6046b9ef","Type":"ContainerStarted","Data":"3359893a03846a19b3697f9d0b37b91bac3b2574c8839c1b444630f05c99b00d"} Jul 07 13:54:17.732322 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:17.732291 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="602d86b6-fccb-4577-9ca1-1892c686cfc0" path="/var/lib/kubelet/pods/602d86b6-fccb-4577-9ca1-1892c686cfc0/volumes" Jul 07 13:54:18.682890 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:18.682855 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06101efc-a19a-4546-961c-4c8c6046b9ef","Type":"ContainerStarted","Data":"34343cef9642ff03ad90bf46d3a94f27e240aaa16a6580cb66ed5826028ad35b"} Jul 07 13:54:18.683319 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:18.682915 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06101efc-a19a-4546-961c-4c8c6046b9ef","Type":"ContainerStarted","Data":"b33db7520796f433b2613b7cb1487dc384bac9fa4baa9cbed06d48081e295ec3"} Jul 07 13:54:18.683319 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:18.682939 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06101efc-a19a-4546-961c-4c8c6046b9ef","Type":"ContainerStarted","Data":"12a6c26f20994dc5f0f0cd0b4037db148b4ac17c3a358d51a64d14e7764c4d1e"} Jul 07 13:54:18.683319 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:18.682963 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06101efc-a19a-4546-961c-4c8c6046b9ef","Type":"ContainerStarted","Data":"a9c93a7d513cfd9b59434aba574ab29a21259a395d33082eec6c2ae7ed17a62e"} Jul 07 13:54:18.683319 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:18.682986 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06101efc-a19a-4546-961c-4c8c6046b9ef","Type":"ContainerStarted","Data":"099bfe61ccdf5cd930f411d09a5894a21fac0dd5995d3af843d448a7247cc507"} Jul 07 13:54:18.683319 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:18.683007 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06101efc-a19a-4546-961c-4c8c6046b9ef","Type":"ContainerStarted","Data":"c6e68e36c1ce7eac2b50ce79135e808927198d6187756c406af30833d73adb9b"} Jul 07 13:54:18.711794 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:18.711732 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.6912251339999997 podStartE2EDuration="2.711710228s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.485094ms" isStatefulPod=false podCreationTimestamp="2026-07-07 13:54:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:54:18.710157644 +0000 UTC m=+205.575362126" watchObservedRunningTime="2026-07-07 13:54:18.711710228 +0000 UTC m=+205.576914695" Jul 07 13:54:22.040412 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:22.040376 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:54:31.170611 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:31.170578 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-769494575f-wcq6z"] Jul 07 13:54:56.190724 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.190653 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-769494575f-wcq6z" podUID="73eae971-ab67-4197-a0cd-0288b760124b" containerName="console" containerID="cri-o://2778ea0b281215e4c9995700d26c6d23a3fe8126e7e62d1e5ca8700ea5117b4b" gracePeriod=15 Jul 07 13:54:56.432523 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.432501 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:54:56.515486 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.515393 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-service-ca\") pod \"73eae971-ab67-4197-a0cd-0288b760124b\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " Jul 07 13:54:56.515486 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.515437 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73eae971-ab67-4197-a0cd-0288b760124b-console-oauth-config\") pod \"73eae971-ab67-4197-a0cd-0288b760124b\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " Jul 07 13:54:56.515486 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.515483 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-console-config\") pod \"73eae971-ab67-4197-a0cd-0288b760124b\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " Jul 07 13:54:56.515777 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.515504 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73eae971-ab67-4197-a0cd-0288b760124b-console-serving-cert\") pod \"73eae971-ab67-4197-a0cd-0288b760124b\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " Jul 07 13:54:56.515777 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.515528 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d65f4\" (UniqueName: \"kubernetes.io/projected/73eae971-ab67-4197-a0cd-0288b760124b-kube-api-access-d65f4\") pod \"73eae971-ab67-4197-a0cd-0288b760124b\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " Jul 07 13:54:56.515777 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.515545 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-trusted-ca-bundle\") pod \"73eae971-ab67-4197-a0cd-0288b760124b\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " Jul 07 13:54:56.515777 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.515568 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-oauth-serving-cert\") pod \"73eae971-ab67-4197-a0cd-0288b760124b\" (UID: \"73eae971-ab67-4197-a0cd-0288b760124b\") " Jul 07 13:54:56.515996 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.515901 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-service-ca" (OuterVolumeSpecName: "service-ca") pod "73eae971-ab67-4197-a0cd-0288b760124b" (UID: "73eae971-ab67-4197-a0cd-0288b760124b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:54:56.516101 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.516043 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-console-config" (OuterVolumeSpecName: "console-config") pod "73eae971-ab67-4197-a0cd-0288b760124b" (UID: "73eae971-ab67-4197-a0cd-0288b760124b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:54:56.516149 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.516127 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "73eae971-ab67-4197-a0cd-0288b760124b" (UID: "73eae971-ab67-4197-a0cd-0288b760124b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:54:56.516184 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.516149 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "73eae971-ab67-4197-a0cd-0288b760124b" (UID: "73eae971-ab67-4197-a0cd-0288b760124b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:54:56.517799 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.517776 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73eae971-ab67-4197-a0cd-0288b760124b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "73eae971-ab67-4197-a0cd-0288b760124b" (UID: "73eae971-ab67-4197-a0cd-0288b760124b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:56.517882 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.517791 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73eae971-ab67-4197-a0cd-0288b760124b-kube-api-access-d65f4" (OuterVolumeSpecName: "kube-api-access-d65f4") pod "73eae971-ab67-4197-a0cd-0288b760124b" (UID: "73eae971-ab67-4197-a0cd-0288b760124b"). InnerVolumeSpecName "kube-api-access-d65f4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:54:56.517942 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.517919 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73eae971-ab67-4197-a0cd-0288b760124b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "73eae971-ab67-4197-a0cd-0288b760124b" (UID: "73eae971-ab67-4197-a0cd-0288b760124b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:54:56.616615 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.616581 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-console-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:56.616615 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.616609 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73eae971-ab67-4197-a0cd-0288b760124b-console-serving-cert\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:56.616615 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.616619 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d65f4\" (UniqueName: \"kubernetes.io/projected/73eae971-ab67-4197-a0cd-0288b760124b-kube-api-access-d65f4\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:56.616865 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.616628 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-trusted-ca-bundle\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:56.616865 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.616638 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-oauth-serving-cert\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:56.616865 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.616646 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73eae971-ab67-4197-a0cd-0288b760124b-service-ca\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:56.616865 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.616654 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73eae971-ab67-4197-a0cd-0288b760124b-console-oauth-config\") on node \"ip-10-0-140-38.ec2.internal\" DevicePath \"\"" Jul 07 13:54:56.833745 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.833709 2560 generic.go:356] "Generic (PLEG): container finished" podID="73eae971-ab67-4197-a0cd-0288b760124b" containerID="2778ea0b281215e4c9995700d26c6d23a3fe8126e7e62d1e5ca8700ea5117b4b" exitCode=0 Jul 07 13:54:56.833936 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.833756 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769494575f-wcq6z" Jul 07 13:54:56.833936 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.833798 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769494575f-wcq6z" event={"ID":"73eae971-ab67-4197-a0cd-0288b760124b","Type":"ContainerDied","Data":"2778ea0b281215e4c9995700d26c6d23a3fe8126e7e62d1e5ca8700ea5117b4b"} Jul 07 13:54:56.833936 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.833872 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769494575f-wcq6z" event={"ID":"73eae971-ab67-4197-a0cd-0288b760124b","Type":"ContainerDied","Data":"ceca03a6d0c757ec0251ae97e6f7d0f70eb77002e4a860d8d57273d87c52df34"} Jul 07 13:54:56.833936 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.833894 2560 scope.go:117] "RemoveContainer" containerID="2778ea0b281215e4c9995700d26c6d23a3fe8126e7e62d1e5ca8700ea5117b4b" Jul 07 13:54:56.842906 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.842885 2560 scope.go:117] "RemoveContainer" containerID="2778ea0b281215e4c9995700d26c6d23a3fe8126e7e62d1e5ca8700ea5117b4b" Jul 07 13:54:56.843175 ip-10-0-140-38 kubenswrapper[2560]: E0707 13:54:56.843157 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2778ea0b281215e4c9995700d26c6d23a3fe8126e7e62d1e5ca8700ea5117b4b\": container with ID starting with 2778ea0b281215e4c9995700d26c6d23a3fe8126e7e62d1e5ca8700ea5117b4b not found: ID does not exist" containerID="2778ea0b281215e4c9995700d26c6d23a3fe8126e7e62d1e5ca8700ea5117b4b" Jul 07 13:54:56.843221 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.843184 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2778ea0b281215e4c9995700d26c6d23a3fe8126e7e62d1e5ca8700ea5117b4b"} err="failed to get container status \"2778ea0b281215e4c9995700d26c6d23a3fe8126e7e62d1e5ca8700ea5117b4b\": rpc error: code = NotFound desc = could not find container \"2778ea0b281215e4c9995700d26c6d23a3fe8126e7e62d1e5ca8700ea5117b4b\": container with ID starting with 2778ea0b281215e4c9995700d26c6d23a3fe8126e7e62d1e5ca8700ea5117b4b not found: ID does not exist" Jul 07 13:54:56.854495 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.854466 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-769494575f-wcq6z"] Jul 07 13:54:56.858559 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:56.858534 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-769494575f-wcq6z"] Jul 07 13:54:57.732825 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:54:57.732787 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73eae971-ab67-4197-a0cd-0288b760124b" path="/var/lib/kubelet/pods/73eae971-ab67-4197-a0cd-0288b760124b/volumes" Jul 07 13:55:17.040067 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:55:17.039971 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:55:17.055136 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:55:17.055108 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:55:17.938247 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:55:17.938223 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 13:55:53.556524 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:55:53.556491 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8d597_b575ab4d-03cc-40e2-955b-c82bce6b2d63/ovn-acl-logging/0.log" Jul 07 13:55:53.558972 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:55:53.558944 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8d597_b575ab4d-03cc-40e2-955b-c82bce6b2d63/ovn-acl-logging/0.log" Jul 07 13:55:53.563317 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:55:53.563299 2560 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 13:57:17.875491 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:17.875462 2560 ???:1] "http: TLS handshake error from 10.0.136.89:35564: EOF" Jul 07 13:57:17.877873 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:17.877851 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rwmks_3c340622-81e7-4b51-806b-0aea3eb6394a/global-pull-secret-syncer/0.log" Jul 07 13:57:17.940773 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:17.940748 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ppkhl_1d77967e-57cd-4d6c-b943-c9bb72bbdf0f/konnectivity-agent/0.log" Jul 07 13:57:18.026567 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:18.026542 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-38.ec2.internal_dc314882863d165c307bf7eda7756faa/haproxy/0.log" Jul 07 13:57:21.676568 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:21.676509 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45db34c1-3b3c-4dac-90e7-3cec563da300/alertmanager/0.log" Jul 07 13:57:21.701919 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:21.701896 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45db34c1-3b3c-4dac-90e7-3cec563da300/config-reloader/0.log" Jul 07 13:57:21.728647 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:21.728623 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45db34c1-3b3c-4dac-90e7-3cec563da300/kube-rbac-proxy-web/0.log" Jul 07 13:57:21.758564 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:21.758542 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45db34c1-3b3c-4dac-90e7-3cec563da300/kube-rbac-proxy/0.log" Jul 07 13:57:21.782235 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:21.782215 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45db34c1-3b3c-4dac-90e7-3cec563da300/kube-rbac-proxy-metric/0.log" Jul 07 13:57:21.803964 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:21.803944 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45db34c1-3b3c-4dac-90e7-3cec563da300/prom-label-proxy/0.log" Jul 07 13:57:21.828708 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:21.828682 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45db34c1-3b3c-4dac-90e7-3cec563da300/init-config-reloader/0.log" Jul 07 13:57:21.893556 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:21.893528 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-glqq4_ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6/kube-state-metrics/0.log" Jul 07 13:57:21.916751 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:21.916729 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-glqq4_ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6/kube-rbac-proxy-main/0.log" Jul 07 13:57:21.946959 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:21.946869 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-glqq4_ed72dcf5-92f6-409f-a80e-be6e0e0d2ba6/kube-rbac-proxy-self/0.log" Jul 07 13:57:21.974330 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:21.974283 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7989f86898-jsrlb_376791a7-3947-4c6e-8b15-c5faa8533f6a/metrics-server/0.log" Jul 07 13:57:22.107797 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:22.107769 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mzn5f_fe906d88-1dae-4b85-a216-e1f9a50ab607/node-exporter/0.log" Jul 07 13:57:22.131747 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:22.131729 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mzn5f_fe906d88-1dae-4b85-a216-e1f9a50ab607/kube-rbac-proxy/0.log" Jul 07 13:57:22.155077 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:22.155060 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mzn5f_fe906d88-1dae-4b85-a216-e1f9a50ab607/init-textfile/0.log" Jul 07 13:57:22.261585 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:22.261505 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-z88db_a61a6530-5474-405e-bf6e-8ffc6301e4f6/kube-rbac-proxy-main/0.log" Jul 07 13:57:22.290036 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:22.289998 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-z88db_a61a6530-5474-405e-bf6e-8ffc6301e4f6/kube-rbac-proxy-self/0.log" Jul 07 13:57:22.312326 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:22.312305 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-z88db_a61a6530-5474-405e-bf6e-8ffc6301e4f6/openshift-state-metrics/0.log" Jul 07 13:57:22.359534 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:22.359511 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06101efc-a19a-4546-961c-4c8c6046b9ef/prometheus/0.log" Jul 07 13:57:22.380972 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:22.380951 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06101efc-a19a-4546-961c-4c8c6046b9ef/config-reloader/0.log" Jul 07 13:57:22.405591 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:22.405573 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06101efc-a19a-4546-961c-4c8c6046b9ef/thanos-sidecar/0.log" Jul 07 13:57:22.430481 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:22.430456 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06101efc-a19a-4546-961c-4c8c6046b9ef/kube-rbac-proxy-web/0.log" Jul 07 13:57:22.454102 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:22.454069 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06101efc-a19a-4546-961c-4c8c6046b9ef/kube-rbac-proxy/0.log" Jul 07 13:57:22.474905 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:22.474884 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06101efc-a19a-4546-961c-4c8c6046b9ef/kube-rbac-proxy-thanos/0.log" Jul 07 13:57:22.499383 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:22.499363 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06101efc-a19a-4546-961c-4c8c6046b9ef/init-config-reloader/0.log" Jul 07 13:57:22.582340 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:22.582306 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-rc5fh_40f7a9a0-86dc-4c61-8f99-e929a03a602c/prometheus-operator-admission-webhook/0.log" Jul 07 13:57:24.044222 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:24.044191 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-gskks_bd383f5e-1cbc-42cb-9c9d-61c45f8babd8/networking-console-plugin/0.log" Jul 07 13:57:24.941717 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:24.941685 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-dlgcz_63807a3d-4229-4a12-85cf-2be9e56ce961/download-server/0.log" Jul 07 13:57:25.429891 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.429867 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-m87tt_2a93fe56-1cb3-41f3-9ae2-fb6377c7889e/volume-data-source-validator/0.log" Jul 07 13:57:25.618044 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.618007 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6"] Jul 07 13:57:25.618332 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.618320 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73eae971-ab67-4197-a0cd-0288b760124b" containerName="console" Jul 07 13:57:25.618373 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.618333 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="73eae971-ab67-4197-a0cd-0288b760124b" containerName="console" Jul 07 13:57:25.618409 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.618402 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="73eae971-ab67-4197-a0cd-0288b760124b" containerName="console" Jul 07 13:57:25.621586 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.621555 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:25.623920 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.623901 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5jm4m\"/\"kube-root-ca.crt\"" Jul 07 13:57:25.624043 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.623938 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5jm4m\"/\"openshift-service-ca.crt\"" Jul 07 13:57:25.624465 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.624449 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5jm4m\"/\"default-dockercfg-gnwtp\"" Jul 07 13:57:25.637074 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.637054 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6"] Jul 07 13:57:25.703137 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.703053 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ccb4be7e-81aa-4401-a301-5de0ce1bb7c6-proc\") pod \"perf-node-gather-daemonset-jx8m6\" (UID: \"ccb4be7e-81aa-4401-a301-5de0ce1bb7c6\") " pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:25.703137 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.703105 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kfw7\" (UniqueName: \"kubernetes.io/projected/ccb4be7e-81aa-4401-a301-5de0ce1bb7c6-kube-api-access-7kfw7\") pod \"perf-node-gather-daemonset-jx8m6\" (UID: \"ccb4be7e-81aa-4401-a301-5de0ce1bb7c6\") " pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:25.703313 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.703146 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccb4be7e-81aa-4401-a301-5de0ce1bb7c6-lib-modules\") pod \"perf-node-gather-daemonset-jx8m6\" (UID: \"ccb4be7e-81aa-4401-a301-5de0ce1bb7c6\") " pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:25.703313 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.703178 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ccb4be7e-81aa-4401-a301-5de0ce1bb7c6-podres\") pod \"perf-node-gather-daemonset-jx8m6\" (UID: \"ccb4be7e-81aa-4401-a301-5de0ce1bb7c6\") " pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:25.703313 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.703237 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccb4be7e-81aa-4401-a301-5de0ce1bb7c6-sys\") pod \"perf-node-gather-daemonset-jx8m6\" (UID: \"ccb4be7e-81aa-4401-a301-5de0ce1bb7c6\") " pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:25.804218 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.804178 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ccb4be7e-81aa-4401-a301-5de0ce1bb7c6-proc\") pod \"perf-node-gather-daemonset-jx8m6\" (UID: \"ccb4be7e-81aa-4401-a301-5de0ce1bb7c6\") " pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:25.804418 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.804244 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kfw7\" (UniqueName: \"kubernetes.io/projected/ccb4be7e-81aa-4401-a301-5de0ce1bb7c6-kube-api-access-7kfw7\") pod \"perf-node-gather-daemonset-jx8m6\" (UID: \"ccb4be7e-81aa-4401-a301-5de0ce1bb7c6\") " pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:25.804418 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.804278 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccb4be7e-81aa-4401-a301-5de0ce1bb7c6-lib-modules\") pod \"perf-node-gather-daemonset-jx8m6\" (UID: \"ccb4be7e-81aa-4401-a301-5de0ce1bb7c6\") " pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:25.804418 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.804303 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ccb4be7e-81aa-4401-a301-5de0ce1bb7c6-proc\") pod \"perf-node-gather-daemonset-jx8m6\" (UID: \"ccb4be7e-81aa-4401-a301-5de0ce1bb7c6\") " pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:25.804418 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.804317 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ccb4be7e-81aa-4401-a301-5de0ce1bb7c6-podres\") pod \"perf-node-gather-daemonset-jx8m6\" (UID: \"ccb4be7e-81aa-4401-a301-5de0ce1bb7c6\") " pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:25.804418 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.804377 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccb4be7e-81aa-4401-a301-5de0ce1bb7c6-sys\") pod \"perf-node-gather-daemonset-jx8m6\" (UID: \"ccb4be7e-81aa-4401-a301-5de0ce1bb7c6\") " pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:25.804418 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.804409 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ccb4be7e-81aa-4401-a301-5de0ce1bb7c6-podres\") pod \"perf-node-gather-daemonset-jx8m6\" (UID: \"ccb4be7e-81aa-4401-a301-5de0ce1bb7c6\") " pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:25.804641 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.804424 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccb4be7e-81aa-4401-a301-5de0ce1bb7c6-lib-modules\") pod \"perf-node-gather-daemonset-jx8m6\" (UID: \"ccb4be7e-81aa-4401-a301-5de0ce1bb7c6\") " pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:25.804641 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.804455 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccb4be7e-81aa-4401-a301-5de0ce1bb7c6-sys\") pod \"perf-node-gather-daemonset-jx8m6\" (UID: \"ccb4be7e-81aa-4401-a301-5de0ce1bb7c6\") " pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:25.815043 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.815024 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kfw7\" (UniqueName: \"kubernetes.io/projected/ccb4be7e-81aa-4401-a301-5de0ce1bb7c6-kube-api-access-7kfw7\") pod \"perf-node-gather-daemonset-jx8m6\" (UID: \"ccb4be7e-81aa-4401-a301-5de0ce1bb7c6\") " pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:25.931204 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:25.931170 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:26.060141 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:26.060108 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6"] Jul 07 13:57:26.062995 ip-10-0-140-38 kubenswrapper[2560]: W0707 13:57:26.062961 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podccb4be7e_81aa_4401_a301_5de0ce1bb7c6.slice/crio-827c45b39311bebe6f048474aba22a26472ac58d708618e77c0df8874f4619f1 WatchSource:0}: Error finding container 827c45b39311bebe6f048474aba22a26472ac58d708618e77c0df8874f4619f1: Status 404 returned error can't find the container with id 827c45b39311bebe6f048474aba22a26472ac58d708618e77c0df8874f4619f1 Jul 07 13:57:26.332944 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:26.332919 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5wh59_52b308d7-d010-494b-95d4-76f812b474b0/dns/0.log" Jul 07 13:57:26.353483 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:26.353448 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5wh59_52b308d7-d010-494b-95d4-76f812b474b0/kube-rbac-proxy/0.log" Jul 07 13:57:26.415923 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:26.415891 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" event={"ID":"ccb4be7e-81aa-4401-a301-5de0ce1bb7c6","Type":"ContainerStarted","Data":"65e2d2b9a9d76207527401d95ee94a791c931f31470563f791356194fb4e4f05"} Jul 07 13:57:26.416093 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:26.415937 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" event={"ID":"ccb4be7e-81aa-4401-a301-5de0ce1bb7c6","Type":"ContainerStarted","Data":"827c45b39311bebe6f048474aba22a26472ac58d708618e77c0df8874f4619f1"} Jul 07 13:57:26.416093 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:26.415970 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:26.432767 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:26.432718 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" podStartSLOduration=1.4327012159999999 podStartE2EDuration="1.432701216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:57:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:57:26.432005266 +0000 UTC m=+393.297209730" watchObservedRunningTime="2026-07-07 13:57:26.432701216 +0000 UTC m=+393.297905681" Jul 07 13:57:26.532762 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:26.532737 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zbsrw_67f25601-a3a1-41ef-80da-a2a319e9e59d/dns-node-resolver/0.log" Jul 07 13:57:26.985365 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:26.985339 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rdm4s_b3f5fe49-2e39-4720-8e53-ba898c743f46/node-ca/0.log" Jul 07 13:57:27.965584 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:27.965559 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r7hj6_e388ff14-7f6e-4166-ade2-4d895ed00f2c/serve-healthcheck-canary/0.log" Jul 07 13:57:28.327977 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:28.327950 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-jlsz5_a538900d-f764-4db2-9441-2b5f4338fe03/insights-operator/0.log" Jul 07 13:57:28.328364 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:28.328349 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-jlsz5_a538900d-f764-4db2-9441-2b5f4338fe03/insights-operator/1.log" Jul 07 13:57:28.473118 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:28.473091 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zczhm_e5e5343e-8c1b-4645-b20e-d26164fded60/kube-rbac-proxy/0.log" Jul 07 13:57:28.494390 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:28.494364 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zczhm_e5e5343e-8c1b-4645-b20e-d26164fded60/exporter/0.log" Jul 07 13:57:28.514454 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:28.514426 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zczhm_e5e5343e-8c1b-4645-b20e-d26164fded60/extractor/0.log" Jul 07 13:57:32.428788 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:32.428763 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5jm4m/perf-node-gather-daemonset-jx8m6" Jul 07 13:57:34.041814 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:34.041784 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6jlvw_2319c840-63a7-450c-82be-66f05546af24/kube-multus/0.log" Jul 07 13:57:34.255816 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:34.255747 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqzcq_fe34b77f-15e4-43b5-a924-8fa943ca811e/kube-multus-additional-cni-plugins/0.log" Jul 07 13:57:34.279196 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:34.279171 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqzcq_fe34b77f-15e4-43b5-a924-8fa943ca811e/egress-router-binary-copy/0.log" Jul 07 13:57:34.297138 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:34.297117 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqzcq_fe34b77f-15e4-43b5-a924-8fa943ca811e/cni-plugins/0.log" Jul 07 13:57:34.316318 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:34.316300 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqzcq_fe34b77f-15e4-43b5-a924-8fa943ca811e/bond-cni-plugin/0.log" Jul 07 13:57:34.338035 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:34.338020 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqzcq_fe34b77f-15e4-43b5-a924-8fa943ca811e/routeoverride-cni/0.log" Jul 07 13:57:34.356400 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:34.356381 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqzcq_fe34b77f-15e4-43b5-a924-8fa943ca811e/whereabouts-cni-bincopy/0.log" Jul 07 13:57:34.375934 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:34.375909 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqzcq_fe34b77f-15e4-43b5-a924-8fa943ca811e/whereabouts-cni/0.log" Jul 07 13:57:34.705338 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:34.705302 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jvz97_25b6321b-a8db-4404-8e21-36dffa3f4585/network-metrics-daemon/0.log" Jul 07 13:57:34.722894 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:34.722868 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jvz97_25b6321b-a8db-4404-8e21-36dffa3f4585/kube-rbac-proxy/0.log" Jul 07 13:57:35.517643 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:35.517552 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8d597_b575ab4d-03cc-40e2-955b-c82bce6b2d63/ovn-controller/0.log" Jul 07 13:57:35.534759 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:35.534736 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8d597_b575ab4d-03cc-40e2-955b-c82bce6b2d63/ovn-acl-logging/1.log" Jul 07 13:57:35.534759 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:35.534739 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8d597_b575ab4d-03cc-40e2-955b-c82bce6b2d63/ovn-acl-logging/0.log" Jul 07 13:57:35.551627 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:35.551606 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8d597_b575ab4d-03cc-40e2-955b-c82bce6b2d63/kube-rbac-proxy-node/0.log" Jul 07 13:57:35.569187 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:35.569152 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8d597_b575ab4d-03cc-40e2-955b-c82bce6b2d63/kube-rbac-proxy-ovn-metrics/0.log" Jul 07 13:57:35.585802 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:35.585769 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8d597_b575ab4d-03cc-40e2-955b-c82bce6b2d63/northd/0.log" Jul 07 13:57:35.603067 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:35.603041 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8d597_b575ab4d-03cc-40e2-955b-c82bce6b2d63/nbdb/0.log" Jul 07 13:57:35.621959 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:35.621937 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8d597_b575ab4d-03cc-40e2-955b-c82bce6b2d63/sbdb/0.log" Jul 07 13:57:35.655667 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:35.655644 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8d597_b575ab4d-03cc-40e2-955b-c82bce6b2d63/ovnkube-controller/0.log" Jul 07 13:57:37.099213 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:37.099125 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2vwjz_8dbec015-6c0e-4468-a867-d8cb583b8f6f/network-check-target-container/0.log" Jul 07 13:57:38.057841 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:38.057804 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-594pr_7a138cbd-bb6b-46be-9bcf-4d1030bfad2f/iptables-alerter/0.log" Jul 07 13:57:38.774248 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:38.774219 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-c7spc_b8f2aa2b-7985-4363-84f5-bf0392006b46/tuned/0.log" Jul 07 13:57:41.671123 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:41.671092 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5d46d9ffd4-8h6h2_456fa7a4-c5ab-49c3-aff7-1635fd2c5c35/service-ca-operator/1.log" Jul 07 13:57:41.671931 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:41.671915 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5d46d9ffd4-8h6h2_456fa7a4-c5ab-49c3-aff7-1635fd2c5c35/service-ca-operator/0.log" Jul 07 13:57:41.957679 ip-10-0-140-38 kubenswrapper[2560]: I0707 13:57:41.957605 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-758f599c5-hf49m_760855d0-2000-4ff6-9bb8-ec2d10d9e147/service-ca-controller/0.log"