Jul 13 17:47:40.469297 ip-10-0-138-21 systemd[1]: Starting Kubernetes Kubelet... Jul 13 17:47:40.921219 ip-10-0-138-21 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 17:47:40.921219 ip-10-0-138-21 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 17:47:40.921219 ip-10-0-138-21 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 17:47:40.921219 ip-10-0-138-21 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 17:47:40.921219 ip-10-0-138-21 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 17:47:40.923372 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.923273 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 17:47:40.929768 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929741 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 17:47:40.929768 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929765 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 17:47:40.929768 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929769 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929774 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929777 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929780 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929783 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929792 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929795 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929798 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929800 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929803 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929805 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929808 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929810 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929813 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929815 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929818 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929820 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929823 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929826 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929828 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 17:47:40.929876 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929831 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929834 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929836 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929839 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929841 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929845 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929849 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929852 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929855 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929857 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929860 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929863 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929865 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929868 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929871 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929874 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929876 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929880 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929883 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 17:47:40.930374 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929886 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929888 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929892 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929897 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929901 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929904 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929907 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929910 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929913 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929915 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929918 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929921 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929923 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929926 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929928 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929932 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929934 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929937 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929939 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 17:47:40.930838 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929942 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929944 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929946 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929949 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929963 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929967 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929972 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929976 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929981 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929985 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929990 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929993 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929995 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.929998 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.930000 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.930003 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.930006 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.930008 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.930010 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.930013 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 17:47:40.931458 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.930015 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.930018 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.930020 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.930023 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.930025 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.930027 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.930030 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.931894 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.931900 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.931903 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.931907 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.931910 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.931913 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.931917 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.931920 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.931923 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.931925 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.931928 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 17:47:40.931950 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.931931 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 17:47:40.934285 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934260 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 17:47:40.934285 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934281 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 17:47:40.934285 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934285 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 17:47:40.934285 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934289 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 17:47:40.934285 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934292 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 17:47:40.934285 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934294 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 17:47:40.934285 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934297 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934300 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934303 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934305 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934308 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934310 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934313 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934315 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934318 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934320 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934325 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934329 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934332 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934334 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934337 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934340 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934343 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934345 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934348 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 17:47:40.934550 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934351 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934353 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934356 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934359 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934362 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934364 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934367 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934370 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934373 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934375 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934378 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934380 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934383 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934385 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934388 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934390 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934393 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934396 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934398 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934400 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 17:47:40.935082 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934403 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934405 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934408 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934410 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934413 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934415 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934417 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934420 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934422 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934425 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934427 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934429 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934433 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934436 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934438 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934441 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934443 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934445 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934447 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934450 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 17:47:40.935563 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934453 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934455 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934458 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934462 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934467 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934473 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934476 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934479 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934481 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934484 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934487 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934490 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934493 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934495 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934498 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934501 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934504 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934507 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934510 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 17:47:40.936061 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934513 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934516 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934518 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934520 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934524 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934527 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934529 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934532 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934535 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934537 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934540 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934543 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934545 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934547 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934550 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934970 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934976 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934979 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934982 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934985 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 17:47:40.936514 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934987 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934992 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934995 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.934998 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935001 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935004 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935007 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935009 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935012 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935015 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935018 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935021 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935024 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935027 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935030 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935032 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935035 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935037 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935040 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 17:47:40.937022 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935042 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935045 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935047 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935050 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935053 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935055 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935057 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935060 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935062 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935065 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935068 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935071 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935073 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935076 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935078 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935081 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935083 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935086 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935089 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935092 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 17:47:40.937481 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935094 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935100 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935103 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935106 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935109 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935112 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935114 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935117 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935120 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935122 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935125 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935127 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935129 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935132 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935134 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935137 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935139 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935141 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935144 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935146 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 17:47:40.937983 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935149 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935151 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935154 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935157 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935159 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935162 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935165 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935167 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935170 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935172 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935174 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935178 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935180 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935184 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935188 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935191 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935194 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935196 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935200 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 17:47:40.938460 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935204 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935207 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935209 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935211 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935214 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935216 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935219 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935221 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935224 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935226 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935229 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935233 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935236 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935239 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935242 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935245 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935320 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935327 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935335 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935339 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 17:47:40.938919 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935343 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935346 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935350 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935355 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935358 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935361 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935366 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935370 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935374 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935376 2564 flags.go:64] FLAG: --cgroup-root="" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935379 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935382 2564 flags.go:64] FLAG: --client-ca-file="" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935385 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935388 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935392 2564 flags.go:64] FLAG: --cluster-domain="" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935395 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935398 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935401 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935404 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935414 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935417 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935420 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935423 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935426 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 13 17:47:40.939412 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935429 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935432 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935435 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935438 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935444 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935447 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935450 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935452 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935455 2564 flags.go:64] FLAG: --enable-server="true" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935458 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935463 2564 flags.go:64] FLAG: --event-burst="100" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935466 2564 flags.go:64] FLAG: --event-qps="50" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935469 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935472 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935476 2564 flags.go:64] FLAG: --eviction-hard="" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935479 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935482 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935485 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935488 2564 flags.go:64] FLAG: --eviction-soft="" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935491 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935493 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935497 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935500 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935503 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935505 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 17:47:40.939989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935508 2564 flags.go:64] FLAG: --feature-gates="" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935514 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935517 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935520 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935523 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935525 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935528 2564 flags.go:64] FLAG: --help="false" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935531 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-138-21.ec2.internal" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935534 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935537 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935539 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935544 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935548 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935550 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935553 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935556 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935559 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935561 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935564 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935567 2564 flags.go:64] FLAG: --kube-reserved="" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935570 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935574 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935577 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935580 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 17:47:40.940644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935583 2564 flags.go:64] FLAG: --lock-file="" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935585 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935588 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935591 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935596 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935599 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935602 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935605 2564 flags.go:64] FLAG: --logging-format="text" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935608 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935611 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935614 2564 flags.go:64] FLAG: --manifest-url="" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935616 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935620 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935623 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935627 2564 flags.go:64] FLAG: --max-pods="110" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935630 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935633 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935636 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935639 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935643 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935646 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935649 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935656 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935659 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935662 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 17:47:40.941257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935665 2564 flags.go:64] FLAG: --pod-cidr="" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935668 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935674 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935676 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935680 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935683 2564 flags.go:64] FLAG: --port="10250" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935686 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935689 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09e24a71d6b1f62bd" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935692 2564 flags.go:64] FLAG: --qos-reserved="" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935695 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935697 2564 flags.go:64] FLAG: --register-node="true" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935700 2564 flags.go:64] FLAG: --register-with-taints="" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935704 2564 flags.go:64] FLAG: --registry-burst="10" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935707 2564 flags.go:64] FLAG: --registry-qps="5" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935710 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935712 2564 flags.go:64] FLAG: --reserved-memory="" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935716 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935719 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935721 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935724 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935727 2564 flags.go:64] FLAG: --runonce="false" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935729 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935732 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935735 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935738 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 17:47:40.941861 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935741 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935743 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935748 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935751 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935753 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935756 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935759 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935762 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935764 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935767 2564 flags.go:64] FLAG: --system-cgroups="" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935770 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935776 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935778 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935781 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935785 2564 flags.go:64] FLAG: --tls-min-version="" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935788 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935791 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935793 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935796 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935799 2564 flags.go:64] FLAG: --v="2" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935803 2564 flags.go:64] FLAG: --version="false" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935808 2564 flags.go:64] FLAG: --vmodule="" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935811 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.935814 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935967 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 17:47:40.942556 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935972 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935975 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935978 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935982 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935985 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935988 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935991 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935993 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.935996 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936000 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936003 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936005 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936008 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936011 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936014 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936016 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936019 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936023 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936027 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 17:47:40.943287 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936030 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936032 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936035 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936039 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936043 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936045 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936048 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936051 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936053 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936056 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936064 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936067 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936070 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936074 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936078 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936081 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936084 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936087 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936089 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 17:47:40.943766 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936092 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936094 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936097 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936101 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936104 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936107 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936109 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936111 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936114 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936116 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936119 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936121 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936124 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936127 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936129 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936131 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936134 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936137 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936139 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936142 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 17:47:40.944288 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936144 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936147 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936149 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936152 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936155 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936157 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936160 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936162 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936164 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936167 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936169 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936172 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936174 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936177 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936179 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936183 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936186 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936190 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936192 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936195 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 17:47:40.944778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936197 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936200 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936202 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936204 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936207 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936209 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936212 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936215 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936217 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936219 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936222 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936224 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936226 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936229 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936232 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936234 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936237 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936240 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936242 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 17:47:40.945304 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.936245 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 17:47:40.945778 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.936835 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 17:47:40.945778 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.944404 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 17:47:40.945778 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.944428 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 17:47:40.945778 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.945339 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 17:47:40.945778 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.945347 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 17:47:40.945778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945414 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 17:47:40.945778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945420 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 17:47:40.945778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945423 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 17:47:40.945778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945426 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 17:47:40.945778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945428 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 17:47:40.945778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945431 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 17:47:40.945778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945434 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 17:47:40.945778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945437 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 17:47:40.945778 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945439 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945442 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945445 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945448 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945450 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945453 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945455 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945458 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945460 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945463 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945465 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945467 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945470 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945472 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945474 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945477 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945480 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945482 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945485 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 17:47:40.946152 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945487 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945491 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945496 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945498 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945501 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945503 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945506 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945508 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945511 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945513 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945516 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945518 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945521 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945524 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945526 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945529 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945531 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945534 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945536 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945539 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 17:47:40.946619 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945541 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945544 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945547 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945549 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945552 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945554 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945556 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945559 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945562 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945564 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945566 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945569 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945572 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945575 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945578 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945581 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945584 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945586 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945589 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945592 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 17:47:40.947131 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945594 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945597 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945599 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945601 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945603 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945606 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945608 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945611 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945613 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945616 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945619 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945621 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945624 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945626 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945631 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945635 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945638 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945641 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945645 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 17:47:40.947658 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945650 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 17:47:40.948143 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945653 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 17:47:40.948143 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945656 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 17:47:40.948143 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945659 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 17:47:40.948143 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945662 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 17:47:40.948143 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945665 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 17:47:40.948143 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945668 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 17:47:40.948143 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945671 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 17:47:40.948143 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945673 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 17:47:40.948143 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945677 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 17:47:40.948143 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945680 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 17:47:40.948143 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945682 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 17:47:40.948143 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945685 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 17:47:40.948143 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.945690 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 17:47:40.948143 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945812 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 17:47:40.948143 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945816 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945819 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945822 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945825 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945828 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945830 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945833 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945836 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945839 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945841 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945844 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945846 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945849 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945851 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945854 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945857 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945860 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945862 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945866 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 17:47:40.948507 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945869 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945872 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945875 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945878 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945880 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945883 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945886 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945889 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945892 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945894 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945897 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945900 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945903 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945905 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945908 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945911 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945913 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945915 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945918 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945921 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 17:47:40.948998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945923 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945926 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945928 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945931 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945933 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945936 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945938 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945941 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945943 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945946 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945948 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945950 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945971 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945975 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945979 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945983 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945987 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945989 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945992 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945995 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 17:47:40.949495 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.945998 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946001 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946004 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946006 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946009 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946011 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946014 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946016 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946019 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946021 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946024 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946027 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946029 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946032 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946034 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946037 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946039 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946042 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946044 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946047 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 17:47:40.950005 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946050 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946052 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946054 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946057 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946059 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946062 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946064 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946067 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946072 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946075 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946077 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946081 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946084 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946087 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946091 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946094 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946096 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946098 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 17:47:40.950534 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:40.946101 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 17:47:40.950985 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.946107 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 17:47:40.950985 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.946262 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 17:47:40.950985 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.948940 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 17:47:40.950985 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.950573 2564 server.go:1019] "Starting client certificate rotation" Jul 13 17:47:40.950985 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.950690 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 17:47:40.950985 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.950728 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 17:47:40.953635 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.953619 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 17:47:40.957912 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.957883 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 17:47:40.969686 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.969660 2564 log.go:25] "Validated CRI v1 runtime API" Jul 13 17:47:40.972526 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.972506 2564 log.go:25] "Validated CRI v1 image API" Jul 13 17:47:40.973426 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.973411 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 17:47:40.976311 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.976290 2564 fs.go:135] Filesystem UUIDs: map[12b64b44-5260-435e-947f-1ca92110f7db:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b6f021a7-7bd7-4c2e-a300-1c4bfae17509:/dev/nvme0n1p3] Jul 13 17:47:40.976358 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.976312 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 17:47:40.982598 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.982470 2564 manager.go:216] Machine: {Timestamp:2026-07-13 17:47:40.981160916 +0000 UTC m=+0.383960698 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100166 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e57399bb7342a5f9f384d2e7ced1f SystemUUID:ec2e5739-9bb7-342a-5f9f-384d2e7ced1f BootID:de548996-a655-4577-9ae7-74f6385c46a7 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:25:00:f0:0c:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:25:00:f0:0c:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:5a:4e:0a:34:90 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 17:47:40.982598 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.982591 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 17:47:40.982734 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.982721 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 17:47:40.983947 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.983918 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 17:47:40.984107 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.983950 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-21.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 17:47:40.984868 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.984858 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 17:47:40.984908 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.984871 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 17:47:40.984908 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.984879 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 17:47:40.985118 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.985103 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 17:47:40.985754 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.985740 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 17:47:40.987629 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.987617 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 17:47:40.991106 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.991090 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 13 17:47:40.991466 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.991455 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 17:47:40.991508 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.991494 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 13 17:47:40.991536 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.991514 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 17:47:40.991536 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.991531 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 17:47:40.991586 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.991540 2564 kubelet.go:398] "Adding apiserver pod source" Jul 13 17:47:40.991586 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.991551 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 17:47:40.992004 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.991991 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 17:47:40.992045 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.992015 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 17:47:40.995297 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.995266 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 17:47:40.997640 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.997621 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 17:47:40.997728 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.997660 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 17:47:40.997867 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.997853 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 17:47:40.997938 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.997882 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 17:47:40.997938 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.997899 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 17:47:40.997938 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.997912 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 17:47:40.997938 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.997929 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 17:47:40.998072 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.997943 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 17:47:40.998531 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.998521 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 17:47:40.998582 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.998535 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 17:47:40.998582 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.998546 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 17:47:40.998582 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.998555 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 17:47:40.998582 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.998568 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 17:47:40.998582 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.998580 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 17:47:40.999445 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.999434 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 17:47:40.999492 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:40.999447 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 17:47:41.002810 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.002773 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 17:47:41.003007 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.002979 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-21.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 17:47:41.003007 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.002984 2564 server.go:1268] "Started kubelet" Jul 13 17:47:41.003159 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.003024 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 17:47:41.003159 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.003041 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-21.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 17:47:41.003159 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.003078 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 17:47:41.003295 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.003172 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 17:47:41.004009 ip-10-0-138-21 systemd[1]: Started Kubernetes Kubelet. Jul 13 17:47:41.005060 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.005029 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 17:47:41.010226 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.010184 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tv7q6" Jul 13 17:47:41.011196 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.011175 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 13 17:47:41.012889 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.012866 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 17:47:41.014117 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.011737 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-21.ec2.internal.18c1ea96d7dbcbeb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-21.ec2.internal,UID:ip-10-0-138-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-21.ec2.internal,},FirstTimestamp:2026-07-13 17:47:41.002927083 +0000 UTC m=+0.405726866,LastTimestamp:2026-07-13 17:47:41.002927083 +0000 UTC m=+0.405726866,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-21.ec2.internal,}" Jul 13 17:47:41.014440 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.014421 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tv7q6" Jul 13 17:47:41.015372 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.015356 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 17:47:41.015437 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.015365 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 17:47:41.015437 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.015419 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-21.ec2.internal\" not found" Jul 13 17:47:41.016185 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.016166 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 17:47:41.016185 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.016186 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 17:47:41.016334 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.016211 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 17:47:41.016334 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.016299 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 13 17:47:41.016334 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.016322 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 13 17:47:41.018099 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.018082 2564 factory.go:55] Registering systemd factory Jul 13 17:47:41.018099 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.018101 2564 factory.go:223] Registration of the systemd container factory successfully Jul 13 17:47:41.018343 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.018326 2564 factory.go:153] Registering CRI-O factory Jul 13 17:47:41.018385 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.018347 2564 factory.go:223] Registration of the crio container factory successfully Jul 13 17:47:41.018425 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.018392 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 17:47:41.018425 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.018412 2564 factory.go:103] Registering Raw factory Jul 13 17:47:41.018425 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.018424 2564 manager.go:1196] Started watching for new ooms in manager Jul 13 17:47:41.018843 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.018830 2564 manager.go:349] Starting recovery of all containers Jul 13 17:47:41.027333 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.027308 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 17:47:41.028644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.028625 2564 manager.go:354] Recovery completed Jul 13 17:47:41.030614 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.030592 2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-21.ec2.internal\" not found" node="ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.033483 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.033466 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 17:47:41.035444 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.035425 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientMemory" Jul 13 17:47:41.035554 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.035476 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 17:47:41.035554 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.035490 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientPID" Jul 13 17:47:41.036147 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.036064 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 17:47:41.036147 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.036074 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 17:47:41.036147 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.036091 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 13 17:47:41.036147 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.036065 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 17:47:41.036870 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.036854 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientMemory" Jul 13 17:47:41.036922 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.036884 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 17:47:41.036922 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.036893 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientPID" Jul 13 17:47:41.037321 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.037308 2564 policy_none.go:49] "None policy: Start" Jul 13 17:47:41.037364 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.037325 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 17:47:41.037364 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.037335 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 17:47:41.038305 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.038294 2564 policy_none.go:47] "Start" Jul 13 17:47:41.077222 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.077063 2564 manager.go:337] "Starting Device Plugin manager" Jul 13 17:47:41.077222 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.077107 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 17:47:41.077222 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.077121 2564 server.go:87] "Starting device plugin registration server" Jul 13 17:47:41.077562 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.077445 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 17:47:41.077562 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.077460 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 17:47:41.077711 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.077689 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 17:47:41.077799 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.077783 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 17:47:41.077852 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.077802 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 17:47:41.078573 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.078548 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 17:47:41.078683 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.078609 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-21.ec2.internal\" not found" Jul 13 17:47:41.129535 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.129491 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 17:47:41.130983 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.130947 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 17:47:41.131052 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.131003 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 17:47:41.131052 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.131030 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 17:47:41.131117 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.131074 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 17:47:41.133934 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.133903 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 17:47:41.178240 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.178166 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 17:47:41.179501 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.179479 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientMemory" Jul 13 17:47:41.179630 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.179517 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 17:47:41.179630 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.179531 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientPID" Jul 13 17:47:41.179630 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.179564 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.191062 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.191029 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.191062 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.191062 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-21.ec2.internal\": node \"ip-10-0-138-21.ec2.internal\" not found" Jul 13 17:47:41.225449 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.225418 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-21.ec2.internal\" not found" Jul 13 17:47:41.232102 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.231424 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal"] Jul 13 17:47:41.232173 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.232154 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 17:47:41.233067 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.233047 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientMemory" Jul 13 17:47:41.233150 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.233083 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 17:47:41.233150 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.233107 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientPID" Jul 13 17:47:41.234666 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.234654 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 17:47:41.234795 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.234762 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.234795 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.234793 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 17:47:41.235571 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.235551 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientMemory" Jul 13 17:47:41.235644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.235556 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientMemory" Jul 13 17:47:41.235644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.235605 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 17:47:41.235644 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.235617 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientPID" Jul 13 17:47:41.235780 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.235583 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 17:47:41.235780 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.235672 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientPID" Jul 13 17:47:41.236901 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.236883 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.237004 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.236917 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 17:47:41.237666 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.237653 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientMemory" Jul 13 17:47:41.237732 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.237674 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 17:47:41.237732 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.237688 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeHasSufficientPID" Jul 13 17:47:41.266834 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.266808 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-21.ec2.internal\" not found" node="ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.271460 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.271438 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-21.ec2.internal\" not found" node="ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.317675 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.317638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/16fb4b15b5b9f054086d5c3e130fb480-config\") pod \"kube-apiserver-proxy-ip-10-0-138-21.ec2.internal\" (UID: \"16fb4b15b5b9f054086d5c3e130fb480\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.317675 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.317675 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a33d0960f8c4652a4b079077363f55e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal\" (UID: \"3a33d0960f8c4652a4b079077363f55e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.317839 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.317695 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a33d0960f8c4652a4b079077363f55e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal\" (UID: \"3a33d0960f8c4652a4b079077363f55e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.326135 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.326107 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-21.ec2.internal\" not found" Jul 13 17:47:41.418371 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.418337 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a33d0960f8c4652a4b079077363f55e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal\" (UID: \"3a33d0960f8c4652a4b079077363f55e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.418371 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.418372 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a33d0960f8c4652a4b079077363f55e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal\" (UID: \"3a33d0960f8c4652a4b079077363f55e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.418502 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.418388 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/16fb4b15b5b9f054086d5c3e130fb480-config\") pod \"kube-apiserver-proxy-ip-10-0-138-21.ec2.internal\" (UID: \"16fb4b15b5b9f054086d5c3e130fb480\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.418502 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.418440 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a33d0960f8c4652a4b079077363f55e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal\" (UID: \"3a33d0960f8c4652a4b079077363f55e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.418502 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.418445 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a33d0960f8c4652a4b079077363f55e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal\" (UID: \"3a33d0960f8c4652a4b079077363f55e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.418502 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.418487 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/16fb4b15b5b9f054086d5c3e130fb480-config\") pod \"kube-apiserver-proxy-ip-10-0-138-21.ec2.internal\" (UID: \"16fb4b15b5b9f054086d5c3e130fb480\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.426489 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.426459 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-21.ec2.internal\" not found" Jul 13 17:47:41.527419 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.527343 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-21.ec2.internal\" not found" Jul 13 17:47:41.568560 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.568533 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.573730 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.573711 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" Jul 13 17:47:41.627769 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.627721 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-21.ec2.internal\" not found" Jul 13 17:47:41.728306 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.728271 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-21.ec2.internal\" not found" Jul 13 17:47:41.828839 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:41.828800 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-21.ec2.internal\" not found" Jul 13 17:47:41.879247 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.879214 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 17:47:41.927720 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.927688 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 17:47:41.949846 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.949814 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 17:47:41.950052 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.950015 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 17:47:41.950052 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.950042 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 17:47:41.950141 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.950024 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 17:47:41.950141 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.949997 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 17:47:41.992219 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:41.992172 2564 apiserver.go:52] "Watching apiserver" Jul 13 17:47:42.012755 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.012727 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 17:47:42.013174 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.013152 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-zvwps","openshift-network-diagnostics/network-check-target-z6nrr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl","openshift-cluster-node-tuning-operator/tuned-zl6ls","openshift-multus/multus-245zw","openshift-multus/multus-additional-cni-plugins-jv44q","openshift-network-operator/iptables-alerter-2sk92","openshift-ovn-kubernetes/ovnkube-node-n5x6m","kube-system/global-pull-secret-syncer-svz7l","kube-system/konnectivity-agent-f82xp","openshift-dns/node-resolver-xvcqn","openshift-image-registry/node-ca-vqppg"] Jul 13 17:47:42.015430 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.015402 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:42.015571 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.015481 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvwps" podUID="a938d7f2-3fd3-4def-8106-4e7ae5529979" Jul 13 17:47:42.015686 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.015667 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 17:47:42.015817 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.015667 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" Jul 13 17:47:42.016738 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.016721 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:47:42.016806 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.016790 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6nrr" podUID="2a16bf86-0f45-482d-8b4f-58a84da77eb0" Jul 13 17:47:42.018559 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.018542 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.019790 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.019769 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.021043 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.021019 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-245zw" Jul 13 17:47:42.021264 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.021173 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 17:42:40 +0000 UTC" deadline="2028-02-24 14:58:59.628507262 +0000 UTC" Jul 13 17:47:42.021264 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.021202 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14181h11m17.607310788s" Jul 13 17:47:42.021881 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.021858 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-device-dir\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.021929 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.021898 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-etc-selinux\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.021929 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.021916 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-sys-fs\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.022037 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.021969 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wdtf\" (UniqueName: \"kubernetes.io/projected/c723457c-5381-4f13-84fa-f01a9086e2b8-kube-api-access-7wdtf\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.022037 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.022013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs\") pod \"network-metrics-daemon-zvwps\" (UID: \"a938d7f2-3fd3-4def-8106-4e7ae5529979\") " pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:42.022108 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.022052 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xhqc\" (UniqueName: \"kubernetes.io/projected/a938d7f2-3fd3-4def-8106-4e7ae5529979-kube-api-access-6xhqc\") pod \"network-metrics-daemon-zvwps\" (UID: \"a938d7f2-3fd3-4def-8106-4e7ae5529979\") " pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:42.022108 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.022075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl86n\" (UniqueName: \"kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n\") pod \"network-check-target-z6nrr\" (UID: \"2a16bf86-0f45-482d-8b4f-58a84da77eb0\") " pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:47:42.022108 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.022095 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.022236 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.022113 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-socket-dir\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.022236 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.022183 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-registration-dir\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.022562 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.022542 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cgq6t\"" Jul 13 17:47:42.022649 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.022554 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.023913 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.023897 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2sk92" Jul 13 17:47:42.027055 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.025781 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.028133 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.027806 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:42.028230 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.028181 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svz7l" podUID="b018ff34-b64c-4dfa-acd6-af00b32f4b67" Jul 13 17:47:42.029712 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.029686 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f82xp" Jul 13 17:47:42.031984 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.031485 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xvcqn" Jul 13 17:47:42.033213 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.033191 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vqppg" Jul 13 17:47:42.033500 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.033475 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 17:47:42.033817 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.033646 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 17:47:42.039557 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.039531 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 17:47:42.044497 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.044478 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 17:47:42.044834 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.044816 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 17:47:42.044902 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.044865 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w298k\"" Jul 13 17:47:42.044902 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.044865 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 17:47:42.045045 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.044920 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p28dp\"" Jul 13 17:47:42.045045 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.044936 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xj9hm\"" Jul 13 17:47:42.045045 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.045018 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t965d\"" Jul 13 17:47:42.045151 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.045067 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qs6l6\"" Jul 13 17:47:42.047085 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.047039 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 17:47:42.047085 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.047064 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 17:47:42.047274 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.047099 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 17:47:42.047274 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.047071 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 17:47:42.047274 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.047136 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 17:47:42.047274 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.047255 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 17:47:42.047406 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.047315 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 17:47:42.048337 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.048322 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 17:47:42.048403 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.048356 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 17:47:42.048476 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.048460 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 17:47:42.048529 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.048482 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 17:47:42.048573 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.048531 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 17:47:42.048619 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.048594 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9qfzb\"" Jul 13 17:47:42.048666 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.048621 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 17:47:42.048769 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.048755 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 17:47:42.048825 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.048814 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 17:47:42.048920 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.048888 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 17:47:42.049056 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.048930 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 17:47:42.049056 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.048970 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 17:47:42.049056 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.049021 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 17:47:42.049766 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.049750 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 17:47:42.054876 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.054855 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 17:47:42.055149 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.055129 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 17:47:42.055426 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.055220 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sd2pm\"" Jul 13 17:47:42.055426 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.055220 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" Jul 13 17:47:42.056284 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.056263 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal"] Jul 13 17:47:42.056896 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.056871 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f4vpq\"" Jul 13 17:47:42.065142 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.065111 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 17:47:42.065274 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.065169 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5smpg" Jul 13 17:47:42.067643 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.067622 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5smpg" Jul 13 17:47:42.081691 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.081632 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 17:47:42.082575 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.082557 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal"] Jul 13 17:47:42.107413 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:42.107370 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16fb4b15b5b9f054086d5c3e130fb480.slice/crio-4dda362aab6df075c0532d0697e3953ec07499721c7b7228fa63b1ca854aa549 WatchSource:0}: Error finding container 4dda362aab6df075c0532d0697e3953ec07499721c7b7228fa63b1ca854aa549: Status 404 returned error can't find the container with id 4dda362aab6df075c0532d0697e3953ec07499721c7b7228fa63b1ca854aa549 Jul 13 17:47:42.111546 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.111526 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 17:47:42.117575 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.117380 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 17:47:42.122675 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.122649 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-var-lib-kubelet\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.122788 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.122693 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e58a202-5020-4eda-b3d4-e63b4d1bc89c-host-slash\") pod \"iptables-alerter-2sk92\" (UID: \"0e58a202-5020-4eda-b3d4-e63b4d1bc89c\") " pod="openshift-network-operator/iptables-alerter-2sk92" Jul 13 17:47:42.122788 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.122729 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-sys-fs\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.122788 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.122759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-var-lib-openvswitch\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.122927 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.122787 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-multus-cni-dir\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.122927 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.122808 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-kubernetes\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.122927 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.122834 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-slash\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.122927 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.122859 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-run-systemd\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.122927 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.122897 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f9bbd505-ffac-4022-981c-f71bfb01ede3-agent-certs\") pod \"konnectivity-agent-f82xp\" (UID: \"f9bbd505-ffac-4022-981c-f71bfb01ede3\") " pod="kube-system/konnectivity-agent-f82xp" Jul 13 17:47:42.122927 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.122922 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-os-release\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.123188 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.122968 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.123188 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svdr6\" (UniqueName: \"kubernetes.io/projected/3ec87333-cc94-405e-ae5e-03501dee25f4-kube-api-access-svdr6\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.123188 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123029 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wdtf\" (UniqueName: \"kubernetes.io/projected/c723457c-5381-4f13-84fa-f01a9086e2b8-kube-api-access-7wdtf\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.123188 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123073 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-run-netns\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.123188 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123099 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppx2c\" (UniqueName: \"kubernetes.io/projected/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-kube-api-access-ppx2c\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.123188 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123122 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret\") pod \"global-pull-secret-syncer-svz7l\" (UID: \"b018ff34-b64c-4dfa-acd6-af00b32f4b67\") " pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:42.123188 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123155 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs\") pod \"network-metrics-daemon-zvwps\" (UID: \"a938d7f2-3fd3-4def-8106-4e7ae5529979\") " pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:42.123445 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123196 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-os-release\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.123445 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123221 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-var-lib-kubelet\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.123445 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123321 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-run\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.123445 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123389 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-device-dir\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.123445 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123435 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-multus-conf-dir\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.123445 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.123426 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:47:42.123673 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123458 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-sys-fs\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.123673 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123463 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-device-dir\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.123673 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123507 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-sysconfig\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.123673 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.123551 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs podName:a938d7f2-3fd3-4def-8106-4e7ae5529979 nodeName:}" failed. No retries permitted until 2026-07-13 17:47:42.623531433 +0000 UTC m=+2.026331200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs") pod "network-metrics-daemon-zvwps" (UID: "a938d7f2-3fd3-4def-8106-4e7ae5529979") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:47:42.123673 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl86n\" (UniqueName: \"kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n\") pod \"network-check-target-z6nrr\" (UID: \"2a16bf86-0f45-482d-8b4f-58a84da77eb0\") " pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:47:42.123874 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.123874 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123809 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.123874 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123829 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-registration-dir\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.123874 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.123856 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-cnibin\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.124265 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124246 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-registration-dir\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.124297 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124255 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.124330 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124305 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-cni-netd\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.124392 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124327 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/82a64921-fe7c-4b5a-baad-67821a776384-env-overrides\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.124392 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124365 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/82a64921-fe7c-4b5a-baad-67821a776384-ovn-node-metrics-cert\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.124392 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/82a64921-fe7c-4b5a-baad-67821a776384-ovnkube-script-lib\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.124523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124408 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbcrk\" (UniqueName: \"kubernetes.io/projected/82a64921-fe7c-4b5a-baad-67821a776384-kube-api-access-hbcrk\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.124523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124433 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-systemd\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.124523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124446 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-lib-modules\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.124523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124466 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.124523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124479 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvmb9\" (UniqueName: \"kubernetes.io/projected/0e58a202-5020-4eda-b3d4-e63b4d1bc89c-kube-api-access-kvmb9\") pod \"iptables-alerter-2sk92\" (UID: \"0e58a202-5020-4eda-b3d4-e63b4d1bc89c\") " pod="openshift-network-operator/iptables-alerter-2sk92" Jul 13 17:47:42.124523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124493 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-systemd-units\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.124759 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124526 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-run-ovn-kubernetes\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.124759 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124556 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-run-k8s-cni-cncf-io\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.124759 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124576 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/19c02c32-bd49-4583-9a27-d02d09520252-multus-daemon-config\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.124759 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124596 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-etc-kubernetes\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.124759 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124615 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-cni-binary-copy\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.124759 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124634 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-host\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.124759 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-socket-dir\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.124759 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124669 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-etc-openvswitch\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.124759 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124682 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppmq5\" (UniqueName: \"kubernetes.io/projected/3c882599-36c2-4faf-bde2-90319ddc3b8b-kube-api-access-ppmq5\") pod \"node-ca-vqppg\" (UID: \"3c882599-36c2-4faf-bde2-90319ddc3b8b\") " pod="openshift-image-registry/node-ca-vqppg" Jul 13 17:47:42.124759 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124699 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-cnibin\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.124759 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6sdm\" (UniqueName: \"kubernetes.io/projected/19c02c32-bd49-4583-9a27-d02d09520252-kube-api-access-k6sdm\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.124759 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124741 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b018ff34-b64c-4dfa-acd6-af00b32f4b67-dbus\") pod \"global-pull-secret-syncer-svz7l\" (UID: \"b018ff34-b64c-4dfa-acd6-af00b32f4b67\") " pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:42.124759 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124758 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ec87333-cc94-405e-ae5e-03501dee25f4-tmp\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.125291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124776 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-kubelet\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.125291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124795 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-run-openvswitch\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.125291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124812 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-socket-dir\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.125291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124825 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-cni-bin\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.125291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124843 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f31d603c-f23f-48fe-8f98-6b10c50684e9-hosts-file\") pod \"node-resolver-xvcqn\" (UID: \"f31d603c-f23f-48fe-8f98-6b10c50684e9\") " pod="openshift-dns/node-resolver-xvcqn" Jul 13 17:47:42.125291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124855 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3c882599-36c2-4faf-bde2-90319ddc3b8b-serviceca\") pod \"node-ca-vqppg\" (UID: \"3c882599-36c2-4faf-bde2-90319ddc3b8b\") " pod="openshift-image-registry/node-ca-vqppg" Jul 13 17:47:42.125291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124872 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19c02c32-bd49-4583-9a27-d02d09520252-cni-binary-copy\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.125291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124911 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-multus-socket-dir-parent\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.125291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124938 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-modprobe-d\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.125291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.124980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xhqc\" (UniqueName: \"kubernetes.io/projected/a938d7f2-3fd3-4def-8106-4e7ae5529979-kube-api-access-6xhqc\") pod \"network-metrics-daemon-zvwps\" (UID: \"a938d7f2-3fd3-4def-8106-4e7ae5529979\") " pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:42.125291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125001 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f31d603c-f23f-48fe-8f98-6b10c50684e9-tmp-dir\") pod \"node-resolver-xvcqn\" (UID: \"f31d603c-f23f-48fe-8f98-6b10c50684e9\") " pod="openshift-dns/node-resolver-xvcqn" Jul 13 17:47:42.125291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbtdw\" (UniqueName: \"kubernetes.io/projected/f31d603c-f23f-48fe-8f98-6b10c50684e9-kube-api-access-fbtdw\") pod \"node-resolver-xvcqn\" (UID: \"f31d603c-f23f-48fe-8f98-6b10c50684e9\") " pod="openshift-dns/node-resolver-xvcqn" Jul 13 17:47:42.125291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125025 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-hostroot\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.125291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b018ff34-b64c-4dfa-acd6-af00b32f4b67-kubelet-config\") pod \"global-pull-secret-syncer-svz7l\" (UID: \"b018ff34-b64c-4dfa-acd6-af00b32f4b67\") " pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:42.125291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125073 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-sysctl-d\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.125291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125086 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-sysctl-conf\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.125291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125101 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0e58a202-5020-4eda-b3d4-e63b4d1bc89c-iptables-alerter-script\") pod \"iptables-alerter-2sk92\" (UID: \"0e58a202-5020-4eda-b3d4-e63b4d1bc89c\") " pod="openshift-network-operator/iptables-alerter-2sk92" Jul 13 17:47:42.125744 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125142 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-node-log\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.125744 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125173 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-var-lib-cni-bin\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.125744 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125195 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-tuned\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.125744 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125219 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.125744 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125242 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-run-ovn\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.125744 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125263 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-run-netns\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.125744 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125284 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-var-lib-cni-multus\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.125744 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125308 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-run-multus-certs\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.125744 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125328 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-system-cni-dir\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.125744 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125349 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-sys\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.125744 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125375 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-etc-selinux\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.125744 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125397 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f9bbd505-ffac-4022-981c-f71bfb01ede3-konnectivity-ca\") pod \"konnectivity-agent-f82xp\" (UID: \"f9bbd505-ffac-4022-981c-f71bfb01ede3\") " pod="kube-system/konnectivity-agent-f82xp" Jul 13 17:47:42.125744 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125417 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-log-socket\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.125744 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125436 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/82a64921-fe7c-4b5a-baad-67821a776384-ovnkube-config\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.125744 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125464 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c723457c-5381-4f13-84fa-f01a9086e2b8-etc-selinux\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.125744 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125465 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c882599-36c2-4faf-bde2-90319ddc3b8b-host\") pod \"node-ca-vqppg\" (UID: \"3c882599-36c2-4faf-bde2-90319ddc3b8b\") " pod="openshift-image-registry/node-ca-vqppg" Jul 13 17:47:42.125744 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.125493 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-system-cni-dir\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.134438 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.134359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" event={"ID":"16fb4b15b5b9f054086d5c3e130fb480","Type":"ContainerStarted","Data":"4dda362aab6df075c0532d0697e3953ec07499721c7b7228fa63b1ca854aa549"} Jul 13 17:47:42.138745 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.138718 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 17:47:42.138857 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.138813 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 17:47:42.138857 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.138832 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 17:47:42.138857 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.138843 2564 projected.go:196] Error preparing data for projected volume kube-api-access-hl86n for pod openshift-network-diagnostics/network-check-target-z6nrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:47:42.139040 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.138920 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n podName:2a16bf86-0f45-482d-8b4f-58a84da77eb0 nodeName:}" failed. No retries permitted until 2026-07-13 17:47:42.63890009 +0000 UTC m=+2.041699873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hl86n" (UniqueName: "kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n") pod "network-check-target-z6nrr" (UID: "2a16bf86-0f45-482d-8b4f-58a84da77eb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:47:42.141844 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.141824 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xhqc\" (UniqueName: \"kubernetes.io/projected/a938d7f2-3fd3-4def-8106-4e7ae5529979-kube-api-access-6xhqc\") pod \"network-metrics-daemon-zvwps\" (UID: \"a938d7f2-3fd3-4def-8106-4e7ae5529979\") " pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:42.141917 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.141837 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wdtf\" (UniqueName: \"kubernetes.io/projected/c723457c-5381-4f13-84fa-f01a9086e2b8-kube-api-access-7wdtf\") pod \"aws-ebs-csi-driver-node-ft8sl\" (UID: \"c723457c-5381-4f13-84fa-f01a9086e2b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.152129 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:42.152101 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a33d0960f8c4652a4b079077363f55e.slice/crio-23f9ba0a677cfa943dc8af57fa8b6a12a1a2e2c5e95bd189217097eb45c2f6f8 WatchSource:0}: Error finding container 23f9ba0a677cfa943dc8af57fa8b6a12a1a2e2c5e95bd189217097eb45c2f6f8: Status 404 returned error can't find the container with id 23f9ba0a677cfa943dc8af57fa8b6a12a1a2e2c5e95bd189217097eb45c2f6f8 Jul 13 17:47:42.226287 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226255 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-cni-netd\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.226287 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226290 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/82a64921-fe7c-4b5a-baad-67821a776384-env-overrides\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.226523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226317 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/82a64921-fe7c-4b5a-baad-67821a776384-ovn-node-metrics-cert\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.226523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/82a64921-fe7c-4b5a-baad-67821a776384-ovnkube-script-lib\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.226523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226348 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbcrk\" (UniqueName: \"kubernetes.io/projected/82a64921-fe7c-4b5a-baad-67821a776384-kube-api-access-hbcrk\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.226523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226376 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-cni-netd\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.226523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226384 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-systemd\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.226523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226437 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-systemd\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.226523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226437 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-lib-modules\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.226523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.226523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvmb9\" (UniqueName: \"kubernetes.io/projected/0e58a202-5020-4eda-b3d4-e63b4d1bc89c-kube-api-access-kvmb9\") pod \"iptables-alerter-2sk92\" (UID: \"0e58a202-5020-4eda-b3d4-e63b4d1bc89c\") " pod="openshift-network-operator/iptables-alerter-2sk92" Jul 13 17:47:42.226523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-systemd-units\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226541 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-lib-modules\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-run-ovn-kubernetes\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-run-k8s-cni-cncf-io\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226582 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-run-ovn-kubernetes\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226619 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-run-k8s-cni-cncf-io\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226653 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-systemd-units\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226667 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/19c02c32-bd49-4583-9a27-d02d09520252-multus-daemon-config\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-etc-kubernetes\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226733 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-cni-binary-copy\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-host\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-etc-openvswitch\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226815 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppmq5\" (UniqueName: \"kubernetes.io/projected/3c882599-36c2-4faf-bde2-90319ddc3b8b-kube-api-access-ppmq5\") pod \"node-ca-vqppg\" (UID: \"3c882599-36c2-4faf-bde2-90319ddc3b8b\") " pod="openshift-image-registry/node-ca-vqppg" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226755 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-etc-kubernetes\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226837 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-cnibin\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6sdm\" (UniqueName: \"kubernetes.io/projected/19c02c32-bd49-4583-9a27-d02d09520252-kube-api-access-k6sdm\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226878 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b018ff34-b64c-4dfa-acd6-af00b32f4b67-dbus\") pod \"global-pull-secret-syncer-svz7l\" (UID: \"b018ff34-b64c-4dfa-acd6-af00b32f4b67\") " pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226882 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-host\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.226980 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226897 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ec87333-cc94-405e-ae5e-03501dee25f4-tmp\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226929 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-kubelet\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226946 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-cnibin\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.226970 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-run-openvswitch\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227005 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-cni-bin\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227008 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-run-openvswitch\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f31d603c-f23f-48fe-8f98-6b10c50684e9-hosts-file\") pod \"node-resolver-xvcqn\" (UID: \"f31d603c-f23f-48fe-8f98-6b10c50684e9\") " pod="openshift-dns/node-resolver-xvcqn" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227051 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/82a64921-fe7c-4b5a-baad-67821a776384-ovnkube-script-lib\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227059 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3c882599-36c2-4faf-bde2-90319ddc3b8b-serviceca\") pod \"node-ca-vqppg\" (UID: \"3c882599-36c2-4faf-bde2-90319ddc3b8b\") " pod="openshift-image-registry/node-ca-vqppg" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227057 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227081 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19c02c32-bd49-4583-9a27-d02d09520252-cni-binary-copy\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227104 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-multus-socket-dir-parent\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227128 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-modprobe-d\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f31d603c-f23f-48fe-8f98-6b10c50684e9-tmp-dir\") pod \"node-resolver-xvcqn\" (UID: \"f31d603c-f23f-48fe-8f98-6b10c50684e9\") " pod="openshift-dns/node-resolver-xvcqn" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227174 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbtdw\" (UniqueName: \"kubernetes.io/projected/f31d603c-f23f-48fe-8f98-6b10c50684e9-kube-api-access-fbtdw\") pod \"node-resolver-xvcqn\" (UID: \"f31d603c-f23f-48fe-8f98-6b10c50684e9\") " pod="openshift-dns/node-resolver-xvcqn" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227196 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-hostroot\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227196 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b018ff34-b64c-4dfa-acd6-af00b32f4b67-dbus\") pod \"global-pull-secret-syncer-svz7l\" (UID: \"b018ff34-b64c-4dfa-acd6-af00b32f4b67\") " pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227238 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-hostroot\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.227776 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227245 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-cni-binary-copy\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.228548 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227240 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-etc-openvswitch\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.228548 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227271 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/19c02c32-bd49-4583-9a27-d02d09520252-multus-daemon-config\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.228548 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b018ff34-b64c-4dfa-acd6-af00b32f4b67-kubelet-config\") pod \"global-pull-secret-syncer-svz7l\" (UID: \"b018ff34-b64c-4dfa-acd6-af00b32f4b67\") " pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:42.228548 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227300 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b018ff34-b64c-4dfa-acd6-af00b32f4b67-kubelet-config\") pod \"global-pull-secret-syncer-svz7l\" (UID: \"b018ff34-b64c-4dfa-acd6-af00b32f4b67\") " pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:42.228548 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227305 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-sysctl-d\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.228548 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227335 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-sysctl-conf\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.228548 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227357 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0e58a202-5020-4eda-b3d4-e63b4d1bc89c-iptables-alerter-script\") pod \"iptables-alerter-2sk92\" (UID: \"0e58a202-5020-4eda-b3d4-e63b4d1bc89c\") " pod="openshift-network-operator/iptables-alerter-2sk92" Jul 13 17:47:42.228548 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227367 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f31d603c-f23f-48fe-8f98-6b10c50684e9-hosts-file\") pod \"node-resolver-xvcqn\" (UID: \"f31d603c-f23f-48fe-8f98-6b10c50684e9\") " pod="openshift-dns/node-resolver-xvcqn" Jul 13 17:47:42.228548 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227402 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-node-log\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.228548 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227407 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-kubelet\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.228548 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-var-lib-cni-bin\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.228548 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227336 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-cni-bin\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.228548 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227451 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-tuned\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.228548 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.228548 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227498 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-run-ovn\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.228548 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-run-netns\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.228548 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227560 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-var-lib-cni-multus\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-run-multus-certs\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227585 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-sysctl-conf\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227601 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-system-cni-dir\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227621 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-sys\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f9bbd505-ffac-4022-981c-f71bfb01ede3-konnectivity-ca\") pod \"konnectivity-agent-f82xp\" (UID: \"f9bbd505-ffac-4022-981c-f71bfb01ede3\") " pod="kube-system/konnectivity-agent-f82xp" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227649 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-log-socket\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227663 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/82a64921-fe7c-4b5a-baad-67821a776384-ovnkube-config\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227683 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c882599-36c2-4faf-bde2-90319ddc3b8b-host\") pod \"node-ca-vqppg\" (UID: \"3c882599-36c2-4faf-bde2-90319ddc3b8b\") " pod="openshift-image-registry/node-ca-vqppg" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227710 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-system-cni-dir\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227772 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-system-cni-dir\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227560 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-sysctl-d\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227787 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19c02c32-bd49-4583-9a27-d02d09520252-cni-binary-copy\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227802 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-modprobe-d\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227820 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-run-multus-certs\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227834 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-var-lib-cni-multus\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-var-lib-kubelet\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227848 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f31d603c-f23f-48fe-8f98-6b10c50684e9-tmp-dir\") pod \"node-resolver-xvcqn\" (UID: \"f31d603c-f23f-48fe-8f98-6b10c50684e9\") " pod="openshift-dns/node-resolver-xvcqn" Jul 13 17:47:42.229301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e58a202-5020-4eda-b3d4-e63b4d1bc89c-host-slash\") pod \"iptables-alerter-2sk92\" (UID: \"0e58a202-5020-4eda-b3d4-e63b4d1bc89c\") " pod="openshift-network-operator/iptables-alerter-2sk92" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227881 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-system-cni-dir\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227882 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-sys\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227919 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-run-ovn\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227966 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-var-lib-openvswitch\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227992 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-multus-cni-dir\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228037 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-var-lib-kubelet\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228068 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c882599-36c2-4faf-bde2-90319ddc3b8b-host\") pod \"node-ca-vqppg\" (UID: \"3c882599-36c2-4faf-bde2-90319ddc3b8b\") " pod="openshift-image-registry/node-ca-vqppg" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.227940 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-run-netns\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228079 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-multus-cni-dir\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228106 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-node-log\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228209 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3c882599-36c2-4faf-bde2-90319ddc3b8b-serviceca\") pod \"node-ca-vqppg\" (UID: \"3c882599-36c2-4faf-bde2-90319ddc3b8b\") " pod="openshift-image-registry/node-ca-vqppg" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228283 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-log-socket\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228330 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-var-lib-openvswitch\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228375 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-var-lib-cni-bin\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228405 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e58a202-5020-4eda-b3d4-e63b4d1bc89c-host-slash\") pod \"iptables-alerter-2sk92\" (UID: \"0e58a202-5020-4eda-b3d4-e63b4d1bc89c\") " pod="openshift-network-operator/iptables-alerter-2sk92" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228435 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f9bbd505-ffac-4022-981c-f71bfb01ede3-konnectivity-ca\") pod \"konnectivity-agent-f82xp\" (UID: \"f9bbd505-ffac-4022-981c-f71bfb01ede3\") " pod="kube-system/konnectivity-agent-f82xp" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228447 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.230009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228444 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-kubernetes\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.230470 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228509 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-kubernetes\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.230470 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228514 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-slash\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.230470 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228550 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-run-systemd\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.230470 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228549 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0e58a202-5020-4eda-b3d4-e63b4d1bc89c-iptables-alerter-script\") pod \"iptables-alerter-2sk92\" (UID: \"0e58a202-5020-4eda-b3d4-e63b4d1bc89c\") " pod="openshift-network-operator/iptables-alerter-2sk92" Jul 13 17:47:42.230470 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228590 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-slash\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.230470 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228592 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-run-systemd\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.230470 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228617 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f9bbd505-ffac-4022-981c-f71bfb01ede3-agent-certs\") pod \"konnectivity-agent-f82xp\" (UID: \"f9bbd505-ffac-4022-981c-f71bfb01ede3\") " pod="kube-system/konnectivity-agent-f82xp" Jul 13 17:47:42.230470 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228686 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-os-release\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.230470 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228748 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-os-release\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.230470 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.230470 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228874 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svdr6\" (UniqueName: \"kubernetes.io/projected/3ec87333-cc94-405e-ae5e-03501dee25f4-kube-api-access-svdr6\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.230470 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.228998 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-multus-socket-dir-parent\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.230470 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-run-netns\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.230470 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229080 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppx2c\" (UniqueName: \"kubernetes.io/projected/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-kube-api-access-ppx2c\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.230470 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229103 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82a64921-fe7c-4b5a-baad-67821a776384-host-run-netns\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.230470 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret\") pod \"global-pull-secret-syncer-svz7l\" (UID: \"b018ff34-b64c-4dfa-acd6-af00b32f4b67\") " pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:42.230470 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229149 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-os-release\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.230973 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-var-lib-kubelet\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.230973 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229195 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-run\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.230973 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-multus-conf-dir\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.230973 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229239 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-sysconfig\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.230973 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229276 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-cnibin\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.230973 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229295 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.230973 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229298 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.230973 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229371 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-run\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.230973 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229386 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-os-release\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.230973 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229409 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-host-var-lib-kubelet\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.230973 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229434 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.230973 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.229450 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 17:47:42.230973 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229477 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19c02c32-bd49-4583-9a27-d02d09520252-multus-conf-dir\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.230973 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229485 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-cnibin\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.230973 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229453 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-sysconfig\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.230973 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.229499 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret podName:b018ff34-b64c-4dfa-acd6-af00b32f4b67 nodeName:}" failed. No retries permitted until 2026-07-13 17:47:42.729484298 +0000 UTC m=+2.132284065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret") pod "global-pull-secret-syncer-svz7l" (UID: "b018ff34-b64c-4dfa-acd6-af00b32f4b67") : object "kube-system"/"original-pull-secret" not registered Jul 13 17:47:42.230973 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229815 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/82a64921-fe7c-4b5a-baad-67821a776384-ovn-node-metrics-cert\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.231391 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229831 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/82a64921-fe7c-4b5a-baad-67821a776384-ovnkube-config\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.231391 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.229857 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/82a64921-fe7c-4b5a-baad-67821a776384-env-overrides\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.231391 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.230042 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ec87333-cc94-405e-ae5e-03501dee25f4-etc-tuned\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.231391 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.230545 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ec87333-cc94-405e-ae5e-03501dee25f4-tmp\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.231391 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.231068 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f9bbd505-ffac-4022-981c-f71bfb01ede3-agent-certs\") pod \"konnectivity-agent-f82xp\" (UID: \"f9bbd505-ffac-4022-981c-f71bfb01ede3\") " pod="kube-system/konnectivity-agent-f82xp" Jul 13 17:47:42.235933 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.235912 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppmq5\" (UniqueName: \"kubernetes.io/projected/3c882599-36c2-4faf-bde2-90319ddc3b8b-kube-api-access-ppmq5\") pod \"node-ca-vqppg\" (UID: \"3c882599-36c2-4faf-bde2-90319ddc3b8b\") " pod="openshift-image-registry/node-ca-vqppg" Jul 13 17:47:42.237640 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.237619 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6sdm\" (UniqueName: \"kubernetes.io/projected/19c02c32-bd49-4583-9a27-d02d09520252-kube-api-access-k6sdm\") pod \"multus-245zw\" (UID: \"19c02c32-bd49-4583-9a27-d02d09520252\") " pod="openshift-multus/multus-245zw" Jul 13 17:47:42.238184 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.238167 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbcrk\" (UniqueName: \"kubernetes.io/projected/82a64921-fe7c-4b5a-baad-67821a776384-kube-api-access-hbcrk\") pod \"ovnkube-node-n5x6m\" (UID: \"82a64921-fe7c-4b5a-baad-67821a776384\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.239193 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.239167 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvmb9\" (UniqueName: \"kubernetes.io/projected/0e58a202-5020-4eda-b3d4-e63b4d1bc89c-kube-api-access-kvmb9\") pod \"iptables-alerter-2sk92\" (UID: \"0e58a202-5020-4eda-b3d4-e63b4d1bc89c\") " pod="openshift-network-operator/iptables-alerter-2sk92" Jul 13 17:47:42.239772 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.239743 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppx2c\" (UniqueName: \"kubernetes.io/projected/1ee5e9ae-8b98-4cf8-965a-ed649be3add6-kube-api-access-ppx2c\") pod \"multus-additional-cni-plugins-jv44q\" (UID: \"1ee5e9ae-8b98-4cf8-965a-ed649be3add6\") " pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.240032 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.240018 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svdr6\" (UniqueName: \"kubernetes.io/projected/3ec87333-cc94-405e-ae5e-03501dee25f4-kube-api-access-svdr6\") pod \"tuned-zl6ls\" (UID: \"3ec87333-cc94-405e-ae5e-03501dee25f4\") " pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.240492 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.240480 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbtdw\" (UniqueName: \"kubernetes.io/projected/f31d603c-f23f-48fe-8f98-6b10c50684e9-kube-api-access-fbtdw\") pod \"node-resolver-xvcqn\" (UID: \"f31d603c-f23f-48fe-8f98-6b10c50684e9\") " pod="openshift-dns/node-resolver-xvcqn" Jul 13 17:47:42.352905 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.352807 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" Jul 13 17:47:42.357531 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.357515 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" Jul 13 17:47:42.361079 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:42.361054 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc723457c_5381_4f13_84fa_f01a9086e2b8.slice/crio-ba8e18760498f14818caf4be79f1c65e94b3d17068c3ef95e2ac335af95d6985 WatchSource:0}: Error finding container ba8e18760498f14818caf4be79f1c65e94b3d17068c3ef95e2ac335af95d6985: Status 404 returned error can't find the container with id ba8e18760498f14818caf4be79f1c65e94b3d17068c3ef95e2ac335af95d6985 Jul 13 17:47:42.365241 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:42.365218 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec87333_cc94_405e_ae5e_03501dee25f4.slice/crio-a14f2e3dd57d3dcce2f3646215c33a8ee6fcc98516e83022a1c4e5d69d38eca5 WatchSource:0}: Error finding container a14f2e3dd57d3dcce2f3646215c33a8ee6fcc98516e83022a1c4e5d69d38eca5: Status 404 returned error can't find the container with id a14f2e3dd57d3dcce2f3646215c33a8ee6fcc98516e83022a1c4e5d69d38eca5 Jul 13 17:47:42.374468 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.374439 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-245zw" Jul 13 17:47:42.382277 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:42.382252 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c02c32_bd49_4583_9a27_d02d09520252.slice/crio-cddeeb1df86f04482e11bbb8ef89a1d7d86921694d12e02c74be703315d36aaf WatchSource:0}: Error finding container cddeeb1df86f04482e11bbb8ef89a1d7d86921694d12e02c74be703315d36aaf: Status 404 returned error can't find the container with id cddeeb1df86f04482e11bbb8ef89a1d7d86921694d12e02c74be703315d36aaf Jul 13 17:47:42.389447 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.389424 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jv44q" Jul 13 17:47:42.396527 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:42.396500 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee5e9ae_8b98_4cf8_965a_ed649be3add6.slice/crio-a38f1b61090016dc57abddbf79529ffadcdc4804111611ae5da5cbf4c3f5979a WatchSource:0}: Error finding container a38f1b61090016dc57abddbf79529ffadcdc4804111611ae5da5cbf4c3f5979a: Status 404 returned error can't find the container with id a38f1b61090016dc57abddbf79529ffadcdc4804111611ae5da5cbf4c3f5979a Jul 13 17:47:42.412755 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.412725 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2sk92" Jul 13 17:47:42.419107 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.419084 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:47:42.421161 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:42.421137 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e58a202_5020_4eda_b3d4_e63b4d1bc89c.slice/crio-3a0ddb583a1330a3540fb2f7d3a5642575f4ffefec74aa8db0020cedd5444c7b WatchSource:0}: Error finding container 3a0ddb583a1330a3540fb2f7d3a5642575f4ffefec74aa8db0020cedd5444c7b: Status 404 returned error can't find the container with id 3a0ddb583a1330a3540fb2f7d3a5642575f4ffefec74aa8db0020cedd5444c7b Jul 13 17:47:42.426384 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.426366 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f82xp" Jul 13 17:47:42.426616 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:42.426585 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a64921_fe7c_4b5a_baad_67821a776384.slice/crio-20cce2c274aa5791e186e48632ee0ebfc43f4c73554eb2ea910ea2878cadcbe7 WatchSource:0}: Error finding container 20cce2c274aa5791e186e48632ee0ebfc43f4c73554eb2ea910ea2878cadcbe7: Status 404 returned error can't find the container with id 20cce2c274aa5791e186e48632ee0ebfc43f4c73554eb2ea910ea2878cadcbe7 Jul 13 17:47:42.433279 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.433259 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xvcqn" Jul 13 17:47:42.437560 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:42.437529 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9bbd505_ffac_4022_981c_f71bfb01ede3.slice/crio-a4312bcb0f21965a5b4fc34a89fafc6ca06a66029f8b6dfaacd3119eec031cb5 WatchSource:0}: Error finding container a4312bcb0f21965a5b4fc34a89fafc6ca06a66029f8b6dfaacd3119eec031cb5: Status 404 returned error can't find the container with id a4312bcb0f21965a5b4fc34a89fafc6ca06a66029f8b6dfaacd3119eec031cb5 Jul 13 17:47:42.437661 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.437554 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vqppg" Jul 13 17:47:42.445285 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:42.445084 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf31d603c_f23f_48fe_8f98_6b10c50684e9.slice/crio-c96c54fd84a5e0d5723254b5c9e1daabdeaa5b0d20a8927bf5613e63429711aa WatchSource:0}: Error finding container c96c54fd84a5e0d5723254b5c9e1daabdeaa5b0d20a8927bf5613e63429711aa: Status 404 returned error can't find the container with id c96c54fd84a5e0d5723254b5c9e1daabdeaa5b0d20a8927bf5613e63429711aa Jul 13 17:47:42.446363 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:47:42.446342 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c882599_36c2_4faf_bde2_90319ddc3b8b.slice/crio-fe824ec64c347ff66c5fb98eee9d12619f43f1903e4df7f265f0566d30966f90 WatchSource:0}: Error finding container fe824ec64c347ff66c5fb98eee9d12619f43f1903e4df7f265f0566d30966f90: Status 404 returned error can't find the container with id fe824ec64c347ff66c5fb98eee9d12619f43f1903e4df7f265f0566d30966f90 Jul 13 17:47:42.633223 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.633142 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs\") pod \"network-metrics-daemon-zvwps\" (UID: \"a938d7f2-3fd3-4def-8106-4e7ae5529979\") " pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:42.633366 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.633289 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:47:42.633366 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.633348 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs podName:a938d7f2-3fd3-4def-8106-4e7ae5529979 nodeName:}" failed. No retries permitted until 2026-07-13 17:47:43.633330977 +0000 UTC m=+3.036130761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs") pod "network-metrics-daemon-zvwps" (UID: "a938d7f2-3fd3-4def-8106-4e7ae5529979") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:47:42.733716 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.733682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret\") pod \"global-pull-secret-syncer-svz7l\" (UID: \"b018ff34-b64c-4dfa-acd6-af00b32f4b67\") " pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:42.733866 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.733724 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl86n\" (UniqueName: \"kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n\") pod \"network-check-target-z6nrr\" (UID: \"2a16bf86-0f45-482d-8b4f-58a84da77eb0\") " pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:47:42.733866 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.733855 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 17:47:42.733978 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.733869 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 17:47:42.733978 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.733878 2564 projected.go:196] Error preparing data for projected volume kube-api-access-hl86n for pod openshift-network-diagnostics/network-check-target-z6nrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:47:42.733978 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.733931 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n podName:2a16bf86-0f45-482d-8b4f-58a84da77eb0 nodeName:}" failed. No retries permitted until 2026-07-13 17:47:43.733912979 +0000 UTC m=+3.136712745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hl86n" (UniqueName: "kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n") pod "network-check-target-z6nrr" (UID: "2a16bf86-0f45-482d-8b4f-58a84da77eb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:47:42.734130 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.734092 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 17:47:42.734175 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:42.734155 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret podName:b018ff34-b64c-4dfa-acd6-af00b32f4b67 nodeName:}" failed. No retries permitted until 2026-07-13 17:47:43.734138688 +0000 UTC m=+3.136938475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret") pod "global-pull-secret-syncer-svz7l" (UID: "b018ff34-b64c-4dfa-acd6-af00b32f4b67") : object "kube-system"/"original-pull-secret" not registered Jul 13 17:47:42.877170 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.877138 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 17:47:42.990653 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:42.990566 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 17:47:43.069898 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:43.069778 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 17:42:41 +0000 UTC" deadline="2028-03-21 00:01:06.29725412 +0000 UTC" Jul 13 17:47:43.069898 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:43.069833 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14790h13m23.227425474s" Jul 13 17:47:43.155000 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:43.154910 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xvcqn" event={"ID":"f31d603c-f23f-48fe-8f98-6b10c50684e9","Type":"ContainerStarted","Data":"c96c54fd84a5e0d5723254b5c9e1daabdeaa5b0d20a8927bf5613e63429711aa"} Jul 13 17:47:43.165663 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:43.165628 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-245zw" event={"ID":"19c02c32-bd49-4583-9a27-d02d09520252","Type":"ContainerStarted","Data":"cddeeb1df86f04482e11bbb8ef89a1d7d86921694d12e02c74be703315d36aaf"} Jul 13 17:47:43.177706 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:43.177605 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" event={"ID":"3ec87333-cc94-405e-ae5e-03501dee25f4","Type":"ContainerStarted","Data":"a14f2e3dd57d3dcce2f3646215c33a8ee6fcc98516e83022a1c4e5d69d38eca5"} Jul 13 17:47:43.184033 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:43.183989 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" event={"ID":"c723457c-5381-4f13-84fa-f01a9086e2b8","Type":"ContainerStarted","Data":"ba8e18760498f14818caf4be79f1c65e94b3d17068c3ef95e2ac335af95d6985"} Jul 13 17:47:43.187584 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:43.187547 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" event={"ID":"3a33d0960f8c4652a4b079077363f55e","Type":"ContainerStarted","Data":"23f9ba0a677cfa943dc8af57fa8b6a12a1a2e2c5e95bd189217097eb45c2f6f8"} Jul 13 17:47:43.190434 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:43.190401 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vqppg" event={"ID":"3c882599-36c2-4faf-bde2-90319ddc3b8b","Type":"ContainerStarted","Data":"fe824ec64c347ff66c5fb98eee9d12619f43f1903e4df7f265f0566d30966f90"} Jul 13 17:47:43.195265 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:43.195192 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f82xp" event={"ID":"f9bbd505-ffac-4022-981c-f71bfb01ede3","Type":"ContainerStarted","Data":"a4312bcb0f21965a5b4fc34a89fafc6ca06a66029f8b6dfaacd3119eec031cb5"} Jul 13 17:47:43.201078 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:43.201046 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" event={"ID":"82a64921-fe7c-4b5a-baad-67821a776384","Type":"ContainerStarted","Data":"20cce2c274aa5791e186e48632ee0ebfc43f4c73554eb2ea910ea2878cadcbe7"} Jul 13 17:47:43.212178 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:43.212144 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2sk92" event={"ID":"0e58a202-5020-4eda-b3d4-e63b4d1bc89c","Type":"ContainerStarted","Data":"3a0ddb583a1330a3540fb2f7d3a5642575f4ffefec74aa8db0020cedd5444c7b"} Jul 13 17:47:43.215151 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:43.215077 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv44q" event={"ID":"1ee5e9ae-8b98-4cf8-965a-ed649be3add6","Type":"ContainerStarted","Data":"a38f1b61090016dc57abddbf79529ffadcdc4804111611ae5da5cbf4c3f5979a"} Jul 13 17:47:43.641604 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:43.641566 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs\") pod \"network-metrics-daemon-zvwps\" (UID: \"a938d7f2-3fd3-4def-8106-4e7ae5529979\") " pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:43.641774 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:43.641738 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:47:43.641830 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:43.641815 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs podName:a938d7f2-3fd3-4def-8106-4e7ae5529979 nodeName:}" failed. No retries permitted until 2026-07-13 17:47:45.641794817 +0000 UTC m=+5.044594607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs") pod "network-metrics-daemon-zvwps" (UID: "a938d7f2-3fd3-4def-8106-4e7ae5529979") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:47:43.742429 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:43.742385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret\") pod \"global-pull-secret-syncer-svz7l\" (UID: \"b018ff34-b64c-4dfa-acd6-af00b32f4b67\") " pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:43.742676 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:43.742457 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl86n\" (UniqueName: \"kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n\") pod \"network-check-target-z6nrr\" (UID: \"2a16bf86-0f45-482d-8b4f-58a84da77eb0\") " pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:47:43.742676 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:43.742628 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 17:47:43.742676 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:43.742646 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 17:47:43.742676 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:43.742658 2564 projected.go:196] Error preparing data for projected volume kube-api-access-hl86n for pod openshift-network-diagnostics/network-check-target-z6nrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:47:43.742899 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:43.742717 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n podName:2a16bf86-0f45-482d-8b4f-58a84da77eb0 nodeName:}" failed. No retries permitted until 2026-07-13 17:47:45.742698213 +0000 UTC m=+5.145497984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hl86n" (UniqueName: "kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n") pod "network-check-target-z6nrr" (UID: "2a16bf86-0f45-482d-8b4f-58a84da77eb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:47:43.743157 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:43.743138 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 17:47:43.743240 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:43.743197 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret podName:b018ff34-b64c-4dfa-acd6-af00b32f4b67 nodeName:}" failed. No retries permitted until 2026-07-13 17:47:45.743181467 +0000 UTC m=+5.145981237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret") pod "global-pull-secret-syncer-svz7l" (UID: "b018ff34-b64c-4dfa-acd6-af00b32f4b67") : object "kube-system"/"original-pull-secret" not registered Jul 13 17:47:44.071083 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:44.071034 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 17:42:41 +0000 UTC" deadline="2028-02-18 23:41:51.057481759 +0000 UTC" Jul 13 17:47:44.071083 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:44.071080 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14045h54m6.98640616s" Jul 13 17:47:44.131890 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:44.131857 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:44.132073 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:44.132018 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvwps" podUID="a938d7f2-3fd3-4def-8106-4e7ae5529979" Jul 13 17:47:44.132154 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:44.132131 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:47:44.132258 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:44.132213 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6nrr" podUID="2a16bf86-0f45-482d-8b4f-58a84da77eb0" Jul 13 17:47:44.132322 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:44.132278 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:44.132371 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:44.132344 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svz7l" podUID="b018ff34-b64c-4dfa-acd6-af00b32f4b67" Jul 13 17:47:44.301611 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:44.301575 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 17:47:44.721221 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:44.721096 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 17:47:45.661302 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:45.661252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs\") pod \"network-metrics-daemon-zvwps\" (UID: \"a938d7f2-3fd3-4def-8106-4e7ae5529979\") " pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:45.661715 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:45.661417 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:47:45.661715 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:45.661488 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs podName:a938d7f2-3fd3-4def-8106-4e7ae5529979 nodeName:}" failed. No retries permitted until 2026-07-13 17:47:49.661466645 +0000 UTC m=+9.064266417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs") pod "network-metrics-daemon-zvwps" (UID: "a938d7f2-3fd3-4def-8106-4e7ae5529979") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:47:45.762571 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:45.762527 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret\") pod \"global-pull-secret-syncer-svz7l\" (UID: \"b018ff34-b64c-4dfa-acd6-af00b32f4b67\") " pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:45.762745 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:45.762599 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl86n\" (UniqueName: \"kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n\") pod \"network-check-target-z6nrr\" (UID: \"2a16bf86-0f45-482d-8b4f-58a84da77eb0\") " pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:47:45.762745 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:45.762727 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 17:47:45.762855 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:45.762748 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 17:47:45.762855 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:45.762763 2564 projected.go:196] Error preparing data for projected volume kube-api-access-hl86n for pod openshift-network-diagnostics/network-check-target-z6nrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:47:45.762855 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:45.762814 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n podName:2a16bf86-0f45-482d-8b4f-58a84da77eb0 nodeName:}" failed. No retries permitted until 2026-07-13 17:47:49.762799716 +0000 UTC m=+9.165599484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hl86n" (UniqueName: "kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n") pod "network-check-target-z6nrr" (UID: "2a16bf86-0f45-482d-8b4f-58a84da77eb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:47:45.763235 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:45.763207 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 17:47:45.763347 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:45.763253 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret podName:b018ff34-b64c-4dfa-acd6-af00b32f4b67 nodeName:}" failed. No retries permitted until 2026-07-13 17:47:49.763238748 +0000 UTC m=+9.166038517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret") pod "global-pull-secret-syncer-svz7l" (UID: "b018ff34-b64c-4dfa-acd6-af00b32f4b67") : object "kube-system"/"original-pull-secret" not registered Jul 13 17:47:46.131731 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:46.131690 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:46.131925 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:46.131831 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svz7l" podUID="b018ff34-b64c-4dfa-acd6-af00b32f4b67" Jul 13 17:47:46.132015 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:46.131935 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:46.132086 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:46.132071 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvwps" podUID="a938d7f2-3fd3-4def-8106-4e7ae5529979" Jul 13 17:47:46.132143 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:46.132131 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:47:46.132212 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:46.132196 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6nrr" podUID="2a16bf86-0f45-482d-8b4f-58a84da77eb0" Jul 13 17:47:48.132808 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:48.131948 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:47:48.132808 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:48.132121 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6nrr" podUID="2a16bf86-0f45-482d-8b4f-58a84da77eb0" Jul 13 17:47:48.132808 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:48.132541 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:48.132808 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:48.132652 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svz7l" podUID="b018ff34-b64c-4dfa-acd6-af00b32f4b67" Jul 13 17:47:48.132808 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:48.132701 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:48.132808 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:48.132752 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvwps" podUID="a938d7f2-3fd3-4def-8106-4e7ae5529979" Jul 13 17:47:49.699162 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:49.699120 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs\") pod \"network-metrics-daemon-zvwps\" (UID: \"a938d7f2-3fd3-4def-8106-4e7ae5529979\") " pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:49.699620 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:49.699314 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:47:49.699620 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:49.699402 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs podName:a938d7f2-3fd3-4def-8106-4e7ae5529979 nodeName:}" failed. No retries permitted until 2026-07-13 17:47:57.699379887 +0000 UTC m=+17.102179661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs") pod "network-metrics-daemon-zvwps" (UID: "a938d7f2-3fd3-4def-8106-4e7ae5529979") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:47:49.799675 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:49.799636 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret\") pod \"global-pull-secret-syncer-svz7l\" (UID: \"b018ff34-b64c-4dfa-acd6-af00b32f4b67\") " pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:49.799866 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:49.799700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl86n\" (UniqueName: \"kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n\") pod \"network-check-target-z6nrr\" (UID: \"2a16bf86-0f45-482d-8b4f-58a84da77eb0\") " pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:47:49.799866 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:49.799861 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 17:47:49.800020 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:49.799884 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 17:47:49.800020 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:49.799898 2564 projected.go:196] Error preparing data for projected volume kube-api-access-hl86n for pod openshift-network-diagnostics/network-check-target-z6nrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:47:49.800020 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:49.799975 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n podName:2a16bf86-0f45-482d-8b4f-58a84da77eb0 nodeName:}" failed. No retries permitted until 2026-07-13 17:47:57.799939025 +0000 UTC m=+17.202738797 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hl86n" (UniqueName: "kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n") pod "network-check-target-z6nrr" (UID: "2a16bf86-0f45-482d-8b4f-58a84da77eb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:47:49.800393 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:49.800373 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 17:47:49.800453 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:49.800434 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret podName:b018ff34-b64c-4dfa-acd6-af00b32f4b67 nodeName:}" failed. No retries permitted until 2026-07-13 17:47:57.800416311 +0000 UTC m=+17.203216086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret") pod "global-pull-secret-syncer-svz7l" (UID: "b018ff34-b64c-4dfa-acd6-af00b32f4b67") : object "kube-system"/"original-pull-secret" not registered Jul 13 17:47:50.131940 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:50.131902 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:50.132143 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:50.132048 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svz7l" podUID="b018ff34-b64c-4dfa-acd6-af00b32f4b67" Jul 13 17:47:50.132406 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:50.132385 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:50.132514 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:50.132492 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvwps" podUID="a938d7f2-3fd3-4def-8106-4e7ae5529979" Jul 13 17:47:50.132584 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:50.132564 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:47:50.132653 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:50.132635 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6nrr" podUID="2a16bf86-0f45-482d-8b4f-58a84da77eb0" Jul 13 17:47:52.132015 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:52.131978 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:52.132492 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:52.132026 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:52.132492 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:52.132134 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:47:52.132492 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:52.132142 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svz7l" podUID="b018ff34-b64c-4dfa-acd6-af00b32f4b67" Jul 13 17:47:52.132492 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:52.132215 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6nrr" podUID="2a16bf86-0f45-482d-8b4f-58a84da77eb0" Jul 13 17:47:52.132492 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:52.132299 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvwps" podUID="a938d7f2-3fd3-4def-8106-4e7ae5529979" Jul 13 17:47:54.131820 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:54.131780 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:54.131820 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:54.131805 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:47:54.132319 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:54.131780 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:54.132319 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:54.131926 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvwps" podUID="a938d7f2-3fd3-4def-8106-4e7ae5529979" Jul 13 17:47:54.132319 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:54.132044 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svz7l" podUID="b018ff34-b64c-4dfa-acd6-af00b32f4b67" Jul 13 17:47:54.132319 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:54.132121 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6nrr" podUID="2a16bf86-0f45-482d-8b4f-58a84da77eb0" Jul 13 17:47:56.131720 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:56.131679 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:56.131720 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:56.131713 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:56.132250 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:56.131677 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:47:56.132250 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:56.131837 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvwps" podUID="a938d7f2-3fd3-4def-8106-4e7ae5529979" Jul 13 17:47:56.132250 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:56.131865 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6nrr" podUID="2a16bf86-0f45-482d-8b4f-58a84da77eb0" Jul 13 17:47:56.132250 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:56.131932 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svz7l" podUID="b018ff34-b64c-4dfa-acd6-af00b32f4b67" Jul 13 17:47:57.758309 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:57.758252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs\") pod \"network-metrics-daemon-zvwps\" (UID: \"a938d7f2-3fd3-4def-8106-4e7ae5529979\") " pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:57.758686 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:57.758412 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:47:57.758686 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:57.758481 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs podName:a938d7f2-3fd3-4def-8106-4e7ae5529979 nodeName:}" failed. No retries permitted until 2026-07-13 17:48:13.758464828 +0000 UTC m=+33.161264596 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs") pod "network-metrics-daemon-zvwps" (UID: "a938d7f2-3fd3-4def-8106-4e7ae5529979") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:47:57.858993 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:57.858942 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret\") pod \"global-pull-secret-syncer-svz7l\" (UID: \"b018ff34-b64c-4dfa-acd6-af00b32f4b67\") " pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:57.859196 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:57.859011 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl86n\" (UniqueName: \"kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n\") pod \"network-check-target-z6nrr\" (UID: \"2a16bf86-0f45-482d-8b4f-58a84da77eb0\") " pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:47:57.859196 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:57.859124 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 17:47:57.859196 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:57.859174 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 17:47:57.859196 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:57.859194 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 17:47:57.859363 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:57.859203 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret podName:b018ff34-b64c-4dfa-acd6-af00b32f4b67 nodeName:}" failed. No retries permitted until 2026-07-13 17:48:13.859183185 +0000 UTC m=+33.261982957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret") pod "global-pull-secret-syncer-svz7l" (UID: "b018ff34-b64c-4dfa-acd6-af00b32f4b67") : object "kube-system"/"original-pull-secret" not registered Jul 13 17:47:57.859363 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:57.859206 2564 projected.go:196] Error preparing data for projected volume kube-api-access-hl86n for pod openshift-network-diagnostics/network-check-target-z6nrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:47:57.859363 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:57.859254 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n podName:2a16bf86-0f45-482d-8b4f-58a84da77eb0 nodeName:}" failed. No retries permitted until 2026-07-13 17:48:13.859238005 +0000 UTC m=+33.262037780 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hl86n" (UniqueName: "kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n") pod "network-check-target-z6nrr" (UID: "2a16bf86-0f45-482d-8b4f-58a84da77eb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:47:58.131927 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:58.131889 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:47:58.132158 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:58.132023 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:47:58.132158 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:47:58.132062 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:47:58.132158 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:58.132058 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svz7l" podUID="b018ff34-b64c-4dfa-acd6-af00b32f4b67" Jul 13 17:47:58.132158 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:58.132140 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6nrr" podUID="2a16bf86-0f45-482d-8b4f-58a84da77eb0" Jul 13 17:47:58.132339 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:47:58.132231 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvwps" podUID="a938d7f2-3fd3-4def-8106-4e7ae5529979" Jul 13 17:48:00.132001 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:00.131938 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:48:00.132001 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:00.131978 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:48:00.132001 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:00.131980 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:48:00.132496 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:00.132095 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svz7l" podUID="b018ff34-b64c-4dfa-acd6-af00b32f4b67" Jul 13 17:48:00.132496 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:00.132171 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6nrr" podUID="2a16bf86-0f45-482d-8b4f-58a84da77eb0" Jul 13 17:48:00.132496 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:00.132268 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvwps" podUID="a938d7f2-3fd3-4def-8106-4e7ae5529979" Jul 13 17:48:02.131330 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:02.131287 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:48:02.131330 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:02.131325 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:48:02.131746 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:02.131287 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:48:02.131746 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:02.131422 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svz7l" podUID="b018ff34-b64c-4dfa-acd6-af00b32f4b67" Jul 13 17:48:02.131746 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:02.131529 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvwps" podUID="a938d7f2-3fd3-4def-8106-4e7ae5529979" Jul 13 17:48:02.131746 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:02.131612 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6nrr" podUID="2a16bf86-0f45-482d-8b4f-58a84da77eb0" Jul 13 17:48:03.260491 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.260455 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" event={"ID":"c723457c-5381-4f13-84fa-f01a9086e2b8","Type":"ContainerStarted","Data":"771f55c23b6960eb15a94fc0b6c466b607e18e5492873581fe317e9bcfd47403"} Jul 13 17:48:03.261886 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.261859 2564 generic.go:356] "Generic (PLEG): container finished" podID="3a33d0960f8c4652a4b079077363f55e" containerID="9723263cb2a5690e174eb63f84817a791462acfa8df9563bf1e4197e845be5d9" exitCode=0 Jul 13 17:48:03.262026 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.261947 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" event={"ID":"3a33d0960f8c4652a4b079077363f55e","Type":"ContainerDied","Data":"9723263cb2a5690e174eb63f84817a791462acfa8df9563bf1e4197e845be5d9"} Jul 13 17:48:03.263366 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.263338 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vqppg" event={"ID":"3c882599-36c2-4faf-bde2-90319ddc3b8b","Type":"ContainerStarted","Data":"14622afa517ce792f697d12a7f25d910cf791689e8d61d28e89daa60b4ed4ae3"} Jul 13 17:48:03.264590 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.264566 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f82xp" event={"ID":"f9bbd505-ffac-4022-981c-f71bfb01ede3","Type":"ContainerStarted","Data":"c93e77ca9049e96eb6fd7f42d44b3d1e4bac0d8b0c899eb9d250c9791ab64c15"} Jul 13 17:48:03.266467 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.266445 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" event={"ID":"82a64921-fe7c-4b5a-baad-67821a776384","Type":"ContainerStarted","Data":"34c5c5e134f441c319873d8ba4905ced784c18c10404f5f26185121230b60875"} Jul 13 17:48:03.266565 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.266521 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" event={"ID":"82a64921-fe7c-4b5a-baad-67821a776384","Type":"ContainerStarted","Data":"6219384c359f498c74f54d7a0d112298ac7d136d61a6aefa531f4c69fa133130"} Jul 13 17:48:03.267808 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.267782 2564 generic.go:356] "Generic (PLEG): container finished" podID="1ee5e9ae-8b98-4cf8-965a-ed649be3add6" containerID="334ea2d03e4fcf924cc803f8ea7305587501b7a31452b0e088642906900d3060" exitCode=0 Jul 13 17:48:03.267898 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.267860 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv44q" event={"ID":"1ee5e9ae-8b98-4cf8-965a-ed649be3add6","Type":"ContainerDied","Data":"334ea2d03e4fcf924cc803f8ea7305587501b7a31452b0e088642906900d3060"} Jul 13 17:48:03.269355 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.269336 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" event={"ID":"16fb4b15b5b9f054086d5c3e130fb480","Type":"ContainerStarted","Data":"937a33364b68b908f7a9736dc4a3da15b2e3d91165a95e5d822b50453f687c8b"} Jul 13 17:48:03.270697 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.270668 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xvcqn" event={"ID":"f31d603c-f23f-48fe-8f98-6b10c50684e9","Type":"ContainerStarted","Data":"17cf87f482fe99cf9c6b54ed59dcf2452c77ba54c2e4a363566af5434a43ff86"} Jul 13 17:48:03.272034 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.272012 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-245zw" event={"ID":"19c02c32-bd49-4583-9a27-d02d09520252","Type":"ContainerStarted","Data":"f49fcb60f87b2a82baaba1b2d27da31b49232d26218302f9285d445a109cd987"} Jul 13 17:48:03.273294 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.273272 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" event={"ID":"3ec87333-cc94-405e-ae5e-03501dee25f4","Type":"ContainerStarted","Data":"ab76e9ad6fcaca23a9ffac01b95602f75b9b7a45adb9d33a3c8d3e2e9b45577d"} Jul 13 17:48:03.327027 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.326919 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f82xp" podStartSLOduration=2.5129516560000003 podStartE2EDuration="22.326901478s" totalImagesPullingTime="19.813949822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:03.326708781 +0000 UTC m=+22.729508575" watchObservedRunningTime="2026-07-13 17:48:03.326901478 +0000 UTC m=+22.729701267" Jul 13 17:48:03.327198 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.327170 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vqppg" podStartSLOduration=2.521708188 podStartE2EDuration="22.327159894s" totalImagesPullingTime="19.805451706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:03.306413221 +0000 UTC m=+22.709213011" watchObservedRunningTime="2026-07-13 17:48:03.327159894 +0000 UTC m=+22.729959684" Jul 13 17:48:03.382612 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.382569 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-21.ec2.internal" podStartSLOduration=22.382549306 podStartE2EDuration="22.382549306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:47:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:03.382469524 +0000 UTC m=+22.785269311" watchObservedRunningTime="2026-07-13 17:48:03.382549306 +0000 UTC m=+22.785349095" Jul 13 17:48:03.406822 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.406580 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zl6ls" podStartSLOduration=2.329925087 podStartE2EDuration="22.406560591s" totalImagesPullingTime="20.076635504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:03.406283807 +0000 UTC m=+22.809083599" watchObservedRunningTime="2026-07-13 17:48:03.406560591 +0000 UTC m=+22.809360381" Jul 13 17:48:03.430698 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.430474 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:03.466590 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.466535 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-245zw" podStartSLOduration=2.409999664 podStartE2EDuration="22.466516192s" totalImagesPullingTime="20.056516528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:03.432890589 +0000 UTC m=+22.835690379" watchObservedRunningTime="2026-07-13 17:48:03.466516192 +0000 UTC m=+22.869316037" Jul 13 17:48:03.515901 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.515865 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:03.606805 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.606770 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:03.715700 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.715663 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:03.877353 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.877316 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f82xp" Jul 13 17:48:03.878037 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.878013 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f82xp" Jul 13 17:48:03.904555 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:03.904501 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xvcqn" podStartSLOduration=2.907877397 podStartE2EDuration="22.904484248s" totalImagesPullingTime="19.996606851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:03.467006781 +0000 UTC m=+22.869806567" watchObservedRunningTime="2026-07-13 17:48:03.904484248 +0000 UTC m=+23.307284065" Jul 13 17:48:04.131801 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.131714 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:48:04.131982 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.131707 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:48:04.131982 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:04.131872 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svz7l" podUID="b018ff34-b64c-4dfa-acd6-af00b32f4b67" Jul 13 17:48:04.131982 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.131727 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:48:04.132127 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:04.132037 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvwps" podUID="a938d7f2-3fd3-4def-8106-4e7ae5529979" Jul 13 17:48:04.132127 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:04.132074 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6nrr" podUID="2a16bf86-0f45-482d-8b4f-58a84da77eb0" Jul 13 17:48:04.279651 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.279623 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5x6m_82a64921-fe7c-4b5a-baad-67821a776384/ovn-acl-logging/0.log" Jul 13 17:48:04.280221 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.280033 2564 generic.go:356] "Generic (PLEG): container finished" podID="82a64921-fe7c-4b5a-baad-67821a776384" containerID="34c5c5e134f441c319873d8ba4905ced784c18c10404f5f26185121230b60875" exitCode=1 Jul 13 17:48:04.280221 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.280078 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" event={"ID":"82a64921-fe7c-4b5a-baad-67821a776384","Type":"ContainerDied","Data":"34c5c5e134f441c319873d8ba4905ced784c18c10404f5f26185121230b60875"} Jul 13 17:48:04.280221 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.280182 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" event={"ID":"82a64921-fe7c-4b5a-baad-67821a776384","Type":"ContainerStarted","Data":"5cd7a5c3010f327573618c9e1f09d98b39aa63a88bdd6daea30f72daafed3710"} Jul 13 17:48:04.280382 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.280231 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" event={"ID":"82a64921-fe7c-4b5a-baad-67821a776384","Type":"ContainerStarted","Data":"7b6e73dcf805cbb97457aa0ecfdc5efae11ee07b90a0585ceff60757136f42f4"} Jul 13 17:48:04.280382 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.280279 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" event={"ID":"82a64921-fe7c-4b5a-baad-67821a776384","Type":"ContainerStarted","Data":"bc7b849abf11cb076f279f0067c17d615c9d7b270bf3a18c4ef084969368b481"} Jul 13 17:48:04.280382 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.280330 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" event={"ID":"82a64921-fe7c-4b5a-baad-67821a776384","Type":"ContainerStarted","Data":"9d8113a6acb91fa2ab0d0ae44495824495c6dac28bfb69c3a9679ec0655eb20d"} Jul 13 17:48:04.281803 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.281767 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2sk92" event={"ID":"0e58a202-5020-4eda-b3d4-e63b4d1bc89c","Type":"ContainerStarted","Data":"66bfd460e6289d0bc8bcef7577cf6defbf73793a3b379234c96904a1a32555de"} Jul 13 17:48:04.284106 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.284013 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" event={"ID":"3a33d0960f8c4652a4b079077363f55e","Type":"ContainerStarted","Data":"5140f7b2a3ead0fa2902fbfe431426e876f7284df2560684fd24f4bbcec1e009"} Jul 13 17:48:04.284452 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.284434 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f82xp" Jul 13 17:48:04.285508 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.285487 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f82xp" Jul 13 17:48:04.332628 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.332413 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2sk92" podStartSLOduration=3.502091199 podStartE2EDuration="23.332391107s" totalImagesPullingTime="19.830299908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:04.303425369 +0000 UTC m=+23.706225158" watchObservedRunningTime="2026-07-13 17:48:04.332391107 +0000 UTC m=+23.735190898" Jul 13 17:48:04.350625 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.350568 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-21.ec2.internal" podStartSLOduration=23.350550245 podStartE2EDuration="23.350550245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:47:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:04.34978475 +0000 UTC m=+23.752584541" watchObservedRunningTime="2026-07-13 17:48:04.350550245 +0000 UTC m=+23.753350035" Jul 13 17:48:04.400297 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.400105 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:04.482313 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.482273 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 17:48:04.508585 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.508550 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:04.618421 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:04.618387 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:05.091084 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:05.090942 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T17:48:04.482302125Z","UUID":"3586f6a5-e934-46b0-9772-f891f01a91c1","Handler":null,"Name":"","Endpoint":""} Jul 13 17:48:05.094607 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:05.094576 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 17:48:05.094777 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:05.094633 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 17:48:05.291312 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:05.291271 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" event={"ID":"c723457c-5381-4f13-84fa-f01a9086e2b8","Type":"ContainerStarted","Data":"b6c5bc21d5d1562539d15e07e9cb0ab49410350b08e5d4e3afdcdbc115b5236e"} Jul 13 17:48:05.894822 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:05.894785 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:06.132069 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:06.131980 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:48:06.132069 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:06.132033 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:48:06.132284 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:06.131993 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:48:06.132284 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:06.132120 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svz7l" podUID="b018ff34-b64c-4dfa-acd6-af00b32f4b67" Jul 13 17:48:06.132284 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:06.132175 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvwps" podUID="a938d7f2-3fd3-4def-8106-4e7ae5529979" Jul 13 17:48:06.132407 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:06.132281 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6nrr" podUID="2a16bf86-0f45-482d-8b4f-58a84da77eb0" Jul 13 17:48:08.131459 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:08.131381 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:48:08.132059 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:08.131495 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:48:08.132059 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:08.131503 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svz7l" podUID="b018ff34-b64c-4dfa-acd6-af00b32f4b67" Jul 13 17:48:08.132059 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:08.131525 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:48:08.132059 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:08.131608 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6nrr" podUID="2a16bf86-0f45-482d-8b4f-58a84da77eb0" Jul 13 17:48:08.132059 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:08.131674 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvwps" podUID="a938d7f2-3fd3-4def-8106-4e7ae5529979" Jul 13 17:48:08.300700 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:08.300663 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" event={"ID":"c723457c-5381-4f13-84fa-f01a9086e2b8","Type":"ContainerStarted","Data":"ef91b2a3a0e328843c5b04ed655d8c1b1a390c99989ad3496991aa7b84a4c998"} Jul 13 17:48:08.303643 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:08.303618 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5x6m_82a64921-fe7c-4b5a-baad-67821a776384/ovn-acl-logging/0.log" Jul 13 17:48:08.304006 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:08.303987 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" event={"ID":"82a64921-fe7c-4b5a-baad-67821a776384","Type":"ContainerStarted","Data":"a867583b19fcdd5f024a43dfc95ea27362ed9bde9441fd8722bd2ef0854381a5"} Jul 13 17:48:08.305626 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:08.305594 2564 generic.go:356] "Generic (PLEG): container finished" podID="1ee5e9ae-8b98-4cf8-965a-ed649be3add6" containerID="ad25353d48d93a373ec7718f0130125bdf8dac99ea3b1beb3f1d78c015af3b28" exitCode=0 Jul 13 17:48:08.305707 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:08.305633 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv44q" event={"ID":"1ee5e9ae-8b98-4cf8-965a-ed649be3add6","Type":"ContainerDied","Data":"ad25353d48d93a373ec7718f0130125bdf8dac99ea3b1beb3f1d78c015af3b28"} Jul 13 17:48:08.324928 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:08.324870 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ft8sl" podStartSLOduration=3.158057369 podStartE2EDuration="27.324855782s" totalImagesPullingTime="24.166798413s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:47:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:08.324619452 +0000 UTC m=+27.727419242" watchObservedRunningTime="2026-07-13 17:48:08.324855782 +0000 UTC m=+27.727655571" Jul 13 17:48:10.131476 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:10.131262 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:48:10.132099 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:10.131262 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:48:10.132099 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:10.131594 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvwps" podUID="a938d7f2-3fd3-4def-8106-4e7ae5529979" Jul 13 17:48:10.132099 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:10.131341 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:48:10.132099 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:10.131644 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svz7l" podUID="b018ff34-b64c-4dfa-acd6-af00b32f4b67" Jul 13 17:48:10.132099 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:10.131718 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6nrr" podUID="2a16bf86-0f45-482d-8b4f-58a84da77eb0" Jul 13 17:48:10.314125 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:10.314093 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5x6m_82a64921-fe7c-4b5a-baad-67821a776384/ovn-acl-logging/0.log" Jul 13 17:48:10.314486 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:10.314462 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" event={"ID":"82a64921-fe7c-4b5a-baad-67821a776384","Type":"ContainerStarted","Data":"8f31116bde54a4dfd48e35acb45435d932db72525b0ac36c27eeae54b0bf9fec"} Jul 13 17:48:10.314763 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:10.314730 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:48:10.314919 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:10.314901 2564 scope.go:117] "RemoveContainer" containerID="34c5c5e134f441c319873d8ba4905ced784c18c10404f5f26185121230b60875" Jul 13 17:48:10.316895 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:10.316871 2564 generic.go:356] "Generic (PLEG): container finished" podID="1ee5e9ae-8b98-4cf8-965a-ed649be3add6" containerID="a956cfc18a33f70ec782ea531978317dfaafe61dea1bc436efb6a966da05ddd1" exitCode=0 Jul 13 17:48:10.316989 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:10.316914 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv44q" event={"ID":"1ee5e9ae-8b98-4cf8-965a-ed649be3add6","Type":"ContainerDied","Data":"a956cfc18a33f70ec782ea531978317dfaafe61dea1bc436efb6a966da05ddd1"} Jul 13 17:48:10.332671 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:10.332646 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:48:11.322151 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:11.322125 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5x6m_82a64921-fe7c-4b5a-baad-67821a776384/ovn-acl-logging/0.log" Jul 13 17:48:11.322509 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:11.322413 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" event={"ID":"82a64921-fe7c-4b5a-baad-67821a776384","Type":"ContainerStarted","Data":"8deb572f9a47e3495252e822f3b8e96880210e5ae6eee385990761d333a6883c"} Jul 13 17:48:11.322689 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:11.322668 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:48:11.322808 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:11.322725 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:48:11.338629 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:11.338603 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:48:11.363349 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:11.363302 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" podStartSLOduration=9.840362497 podStartE2EDuration="30.363287743s" totalImagesPullingTime="20.522925246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:11.363022165 +0000 UTC m=+30.765821954" watchObservedRunningTime="2026-07-13 17:48:11.363287743 +0000 UTC m=+30.766087532" Jul 13 17:48:12.051915 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:12.048399 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-svz7l"] Jul 13 17:48:12.051915 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:12.048860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:48:12.051915 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:12.049021 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svz7l" podUID="b018ff34-b64c-4dfa-acd6-af00b32f4b67" Jul 13 17:48:12.053300 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:12.053269 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zvwps"] Jul 13 17:48:12.053430 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:12.053406 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:48:12.054184 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:12.053510 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvwps" podUID="a938d7f2-3fd3-4def-8106-4e7ae5529979" Jul 13 17:48:12.054184 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:12.053938 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z6nrr"] Jul 13 17:48:12.054184 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:12.054061 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:48:12.054184 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:12.054154 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6nrr" podUID="2a16bf86-0f45-482d-8b4f-58a84da77eb0" Jul 13 17:48:12.327581 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:12.327541 2564 generic.go:356] "Generic (PLEG): container finished" podID="1ee5e9ae-8b98-4cf8-965a-ed649be3add6" containerID="c3799eb19a2df17454c62fd334d8172ce62ae736c3a2447a382ca8ef5947de9b" exitCode=0 Jul 13 17:48:12.328108 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:12.327619 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv44q" event={"ID":"1ee5e9ae-8b98-4cf8-965a-ed649be3add6","Type":"ContainerDied","Data":"c3799eb19a2df17454c62fd334d8172ce62ae736c3a2447a382ca8ef5947de9b"} Jul 13 17:48:12.526000 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:12.525969 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:12.583867 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:12.583782 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:13.778484 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:13.778394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs\") pod \"network-metrics-daemon-zvwps\" (UID: \"a938d7f2-3fd3-4def-8106-4e7ae5529979\") " pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:48:13.779107 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:13.778576 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:48:13.779107 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:13.778638 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs podName:a938d7f2-3fd3-4def-8106-4e7ae5529979 nodeName:}" failed. No retries permitted until 2026-07-13 17:48:45.778621998 +0000 UTC m=+65.181421777 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs") pod "network-metrics-daemon-zvwps" (UID: "a938d7f2-3fd3-4def-8106-4e7ae5529979") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:48:13.878910 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:13.878857 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret\") pod \"global-pull-secret-syncer-svz7l\" (UID: \"b018ff34-b64c-4dfa-acd6-af00b32f4b67\") " pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:48:13.879109 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:13.878922 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl86n\" (UniqueName: \"kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n\") pod \"network-check-target-z6nrr\" (UID: \"2a16bf86-0f45-482d-8b4f-58a84da77eb0\") " pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:48:13.879109 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:13.879057 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 17:48:13.879109 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:13.879071 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 17:48:13.879109 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:13.879094 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 17:48:13.879109 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:13.879107 2564 projected.go:196] Error preparing data for projected volume kube-api-access-hl86n for pod openshift-network-diagnostics/network-check-target-z6nrr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:48:13.879354 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:13.879135 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret podName:b018ff34-b64c-4dfa-acd6-af00b32f4b67 nodeName:}" failed. No retries permitted until 2026-07-13 17:48:45.879115295 +0000 UTC m=+65.281915066 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret") pod "global-pull-secret-syncer-svz7l" (UID: "b018ff34-b64c-4dfa-acd6-af00b32f4b67") : object "kube-system"/"original-pull-secret" not registered Jul 13 17:48:13.879354 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:13.879155 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n podName:2a16bf86-0f45-482d-8b4f-58a84da77eb0 nodeName:}" failed. No retries permitted until 2026-07-13 17:48:45.879145826 +0000 UTC m=+65.281945599 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hl86n" (UniqueName: "kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n") pod "network-check-target-z6nrr" (UID: "2a16bf86-0f45-482d-8b4f-58a84da77eb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:48:14.132229 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:14.132189 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:48:14.132229 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:14.132208 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:48:14.132426 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:14.132338 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:48:14.132426 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:14.132341 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvwps" podUID="a938d7f2-3fd3-4def-8106-4e7ae5529979" Jul 13 17:48:14.132580 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:14.132456 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svz7l" podUID="b018ff34-b64c-4dfa-acd6-af00b32f4b67" Jul 13 17:48:14.132580 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:14.132538 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6nrr" podUID="2a16bf86-0f45-482d-8b4f-58a84da77eb0" Jul 13 17:48:14.702043 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:14.702001 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:14.772512 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:14.772478 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:14.871595 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:14.871565 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:15.928101 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:15.928052 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:15.936172 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:15.934678 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-21.ec2.internal" event="NodeReady" Jul 13 17:48:15.936172 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:15.934824 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 17:48:15.986051 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:15.986014 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-scpjr"] Jul 13 17:48:15.989145 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:15.989115 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-scpjr" Jul 13 17:48:15.990361 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:15.990326 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:15.992329 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:15.992304 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 17:48:15.992642 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:15.992624 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 17:48:15.992718 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:15.992642 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 17:48:15.993236 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:15.993216 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w9474\"" Jul 13 17:48:16.000159 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.000130 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-scpjr"] Jul 13 17:48:16.086971 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.086935 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7fr9t"] Jul 13 17:48:16.089335 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.089299 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:16.092400 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.092372 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 17:48:16.092400 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.092387 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 17:48:16.092598 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.092429 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p7h25\"" Jul 13 17:48:16.097938 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.097918 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fd8f0fe-1073-4482-8848-ef76e7d2257f-cert\") pod \"ingress-canary-scpjr\" (UID: \"6fd8f0fe-1073-4482-8848-ef76e7d2257f\") " pod="openshift-ingress-canary/ingress-canary-scpjr" Jul 13 17:48:16.098100 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.097986 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqzx4\" (UniqueName: \"kubernetes.io/projected/6fd8f0fe-1073-4482-8848-ef76e7d2257f-kube-api-access-tqzx4\") pod \"ingress-canary-scpjr\" (UID: \"6fd8f0fe-1073-4482-8848-ef76e7d2257f\") " pod="openshift-ingress-canary/ingress-canary-scpjr" Jul 13 17:48:16.101749 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.101727 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7fr9t"] Jul 13 17:48:16.131482 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.131442 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:48:16.131676 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.131442 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:48:16.131676 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.131582 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:48:16.136747 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.136714 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 17:48:16.136907 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.136836 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 17:48:16.137336 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.137170 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fjx6r\"" Jul 13 17:48:16.137336 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.137171 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 17:48:16.137336 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.137305 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 17:48:16.137819 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.137802 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m566t\"" Jul 13 17:48:16.198638 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.198552 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1fc718c-9753-471c-963a-2ab6e27a75de-tmp-dir\") pod \"dns-default-7fr9t\" (UID: \"b1fc718c-9753-471c-963a-2ab6e27a75de\") " pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:16.198638 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.198603 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fd8f0fe-1073-4482-8848-ef76e7d2257f-cert\") pod \"ingress-canary-scpjr\" (UID: \"6fd8f0fe-1073-4482-8848-ef76e7d2257f\") " pod="openshift-ingress-canary/ingress-canary-scpjr" Jul 13 17:48:16.198858 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.198682 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b1fc718c-9753-471c-963a-2ab6e27a75de-config-volume\") pod \"dns-default-7fr9t\" (UID: \"b1fc718c-9753-471c-963a-2ab6e27a75de\") " pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:16.198858 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.198754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqzx4\" (UniqueName: \"kubernetes.io/projected/6fd8f0fe-1073-4482-8848-ef76e7d2257f-kube-api-access-tqzx4\") pod \"ingress-canary-scpjr\" (UID: \"6fd8f0fe-1073-4482-8848-ef76e7d2257f\") " pod="openshift-ingress-canary/ingress-canary-scpjr" Jul 13 17:48:16.198858 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.198784 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls\") pod \"dns-default-7fr9t\" (UID: \"b1fc718c-9753-471c-963a-2ab6e27a75de\") " pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:16.198858 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.198810 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8gv7\" (UniqueName: \"kubernetes.io/projected/b1fc718c-9753-471c-963a-2ab6e27a75de-kube-api-access-b8gv7\") pod \"dns-default-7fr9t\" (UID: \"b1fc718c-9753-471c-963a-2ab6e27a75de\") " pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:16.203496 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.203472 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fd8f0fe-1073-4482-8848-ef76e7d2257f-cert\") pod \"ingress-canary-scpjr\" (UID: \"6fd8f0fe-1073-4482-8848-ef76e7d2257f\") " pod="openshift-ingress-canary/ingress-canary-scpjr" Jul 13 17:48:16.210781 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.210757 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqzx4\" (UniqueName: \"kubernetes.io/projected/6fd8f0fe-1073-4482-8848-ef76e7d2257f-kube-api-access-tqzx4\") pod \"ingress-canary-scpjr\" (UID: \"6fd8f0fe-1073-4482-8848-ef76e7d2257f\") " pod="openshift-ingress-canary/ingress-canary-scpjr" Jul 13 17:48:16.211696 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.211672 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:16.282878 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.282838 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:16.299913 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.299874 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b1fc718c-9753-471c-963a-2ab6e27a75de-config-volume\") pod \"dns-default-7fr9t\" (UID: \"b1fc718c-9753-471c-963a-2ab6e27a75de\") " pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:16.299913 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.299917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls\") pod \"dns-default-7fr9t\" (UID: \"b1fc718c-9753-471c-963a-2ab6e27a75de\") " pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:16.300166 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.299947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8gv7\" (UniqueName: \"kubernetes.io/projected/b1fc718c-9753-471c-963a-2ab6e27a75de-kube-api-access-b8gv7\") pod \"dns-default-7fr9t\" (UID: \"b1fc718c-9753-471c-963a-2ab6e27a75de\") " pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:16.300166 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:16.300070 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 17:48:16.300166 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:16.300138 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls podName:b1fc718c-9753-471c-963a-2ab6e27a75de nodeName:}" failed. No retries permitted until 2026-07-13 17:48:16.800121265 +0000 UTC m=+36.202921037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls") pod "dns-default-7fr9t" (UID: "b1fc718c-9753-471c-963a-2ab6e27a75de") : secret "dns-default-metrics-tls" not found Jul 13 17:48:16.300319 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.300211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1fc718c-9753-471c-963a-2ab6e27a75de-tmp-dir\") pod \"dns-default-7fr9t\" (UID: \"b1fc718c-9753-471c-963a-2ab6e27a75de\") " pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:16.300517 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.300497 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1fc718c-9753-471c-963a-2ab6e27a75de-tmp-dir\") pod \"dns-default-7fr9t\" (UID: \"b1fc718c-9753-471c-963a-2ab6e27a75de\") " pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:16.300610 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.300541 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b1fc718c-9753-471c-963a-2ab6e27a75de-config-volume\") pod \"dns-default-7fr9t\" (UID: \"b1fc718c-9753-471c-963a-2ab6e27a75de\") " pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:16.301853 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.301837 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-scpjr" Jul 13 17:48:16.309777 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.309749 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8gv7\" (UniqueName: \"kubernetes.io/projected/b1fc718c-9753-471c-963a-2ab6e27a75de-kube-api-access-b8gv7\") pod \"dns-default-7fr9t\" (UID: \"b1fc718c-9753-471c-963a-2ab6e27a75de\") " pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:16.519635 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.519463 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-scpjr"] Jul 13 17:48:16.522429 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:48:16.522402 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd8f0fe_1073_4482_8848_ef76e7d2257f.slice/crio-4f0da14104b8c4a36e37af443f827df36aa5b1d9b57da134d17b7d2b98a3ee7e WatchSource:0}: Error finding container 4f0da14104b8c4a36e37af443f827df36aa5b1d9b57da134d17b7d2b98a3ee7e: Status 404 returned error can't find the container with id 4f0da14104b8c4a36e37af443f827df36aa5b1d9b57da134d17b7d2b98a3ee7e Jul 13 17:48:16.684586 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.684544 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:16.804296 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:16.804263 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls\") pod \"dns-default-7fr9t\" (UID: \"b1fc718c-9753-471c-963a-2ab6e27a75de\") " pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:16.804484 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:16.804432 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 17:48:16.804545 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:16.804513 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls podName:b1fc718c-9753-471c-963a-2ab6e27a75de nodeName:}" failed. No retries permitted until 2026-07-13 17:48:17.804490864 +0000 UTC m=+37.207290649 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls") pod "dns-default-7fr9t" (UID: "b1fc718c-9753-471c-963a-2ab6e27a75de") : secret "dns-default-metrics-tls" not found Jul 13 17:48:17.345571 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:17.345535 2564 generic.go:356] "Generic (PLEG): container finished" podID="1ee5e9ae-8b98-4cf8-965a-ed649be3add6" containerID="64082cf163fcfb2b991ac33b644be0d74104bebd60384446117b1ef8e7e5c399" exitCode=0 Jul 13 17:48:17.346264 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:17.345622 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv44q" event={"ID":"1ee5e9ae-8b98-4cf8-965a-ed649be3add6","Type":"ContainerDied","Data":"64082cf163fcfb2b991ac33b644be0d74104bebd60384446117b1ef8e7e5c399"} Jul 13 17:48:17.346916 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:17.346892 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-scpjr" event={"ID":"6fd8f0fe-1073-4482-8848-ef76e7d2257f","Type":"ContainerStarted","Data":"4f0da14104b8c4a36e37af443f827df36aa5b1d9b57da134d17b7d2b98a3ee7e"} Jul 13 17:48:17.813869 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:17.813822 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls\") pod \"dns-default-7fr9t\" (UID: \"b1fc718c-9753-471c-963a-2ab6e27a75de\") " pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:17.814056 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:17.814013 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 17:48:17.814098 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:17.814084 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls podName:b1fc718c-9753-471c-963a-2ab6e27a75de nodeName:}" failed. No retries permitted until 2026-07-13 17:48:19.814066117 +0000 UTC m=+39.216865886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls") pod "dns-default-7fr9t" (UID: "b1fc718c-9753-471c-963a-2ab6e27a75de") : secret "dns-default-metrics-tls" not found Jul 13 17:48:18.353656 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.353618 2564 generic.go:356] "Generic (PLEG): container finished" podID="1ee5e9ae-8b98-4cf8-965a-ed649be3add6" containerID="9fa3d6bdba527905efad83e938adaf5c678e0957d9eb404826768c75555a52e4" exitCode=0 Jul 13 17:48:18.354204 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.353674 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv44q" event={"ID":"1ee5e9ae-8b98-4cf8-965a-ed649be3add6","Type":"ContainerDied","Data":"9fa3d6bdba527905efad83e938adaf5c678e0957d9eb404826768c75555a52e4"} Jul 13 17:48:18.757742 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.757653 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:18.790224 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.790180 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8gbm9"] Jul 13 17:48:18.816346 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.816305 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8gbm9"] Jul 13 17:48:18.816522 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.816410 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8gbm9" Jul 13 17:48:18.819379 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.819356 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-mblqt\"" Jul 13 17:48:18.819617 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.819600 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 13 17:48:18.819983 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.819943 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 13 17:48:18.841188 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.841150 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:18.904185 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.904152 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bfbs4"] Jul 13 17:48:18.913860 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.913835 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:18.918177 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.918148 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 17:48:18.918312 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.918210 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 17:48:18.918312 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.918212 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 17:48:18.918507 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.918487 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t8p88\"" Jul 13 17:48:18.919237 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.919220 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 17:48:18.920446 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.920424 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bfbs4"] Jul 13 17:48:18.922936 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.922916 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8khk\" (UniqueName: \"kubernetes.io/projected/44987d76-d577-4f20-9fd3-87e568a82b67-kube-api-access-m8khk\") pod \"migrator-7f59b54f6c-8gbm9\" (UID: \"44987d76-d577-4f20-9fd3-87e568a82b67\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8gbm9" Jul 13 17:48:18.932789 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:18.932763 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:19.003973 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.003919 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:19.023424 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.023349 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8khk\" (UniqueName: \"kubernetes.io/projected/44987d76-d577-4f20-9fd3-87e568a82b67-kube-api-access-m8khk\") pod \"migrator-7f59b54f6c-8gbm9\" (UID: \"44987d76-d577-4f20-9fd3-87e568a82b67\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8gbm9" Jul 13 17:48:19.023424 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.023403 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8209d6b1-4ed7-4dda-a050-9e3122139abf-crio-socket\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:19.023562 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.023437 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:19.023562 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.023490 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:19.023562 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.023519 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z69s6\" (UniqueName: \"kubernetes.io/projected/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-api-access-z69s6\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:19.023654 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.023600 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8209d6b1-4ed7-4dda-a050-9e3122139abf-data-volume\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:19.041639 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.041510 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8khk\" (UniqueName: \"kubernetes.io/projected/44987d76-d577-4f20-9fd3-87e568a82b67-kube-api-access-m8khk\") pod \"migrator-7f59b54f6c-8gbm9\" (UID: \"44987d76-d577-4f20-9fd3-87e568a82b67\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8gbm9" Jul 13 17:48:19.124225 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.124191 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8209d6b1-4ed7-4dda-a050-9e3122139abf-data-volume\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:19.124366 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.124277 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8209d6b1-4ed7-4dda-a050-9e3122139abf-crio-socket\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:19.124366 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.124302 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:19.124366 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.124334 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:19.124518 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.124414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z69s6\" (UniqueName: \"kubernetes.io/projected/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-api-access-z69s6\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:19.124518 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:19.124424 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 17:48:19.124518 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:19.124468 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 17:48:19.124639 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:19.124534 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm podName:8209d6b1-4ed7-4dda-a050-9e3122139abf nodeName:}" failed. No retries permitted until 2026-07-13 17:48:19.624512206 +0000 UTC m=+39.027311973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bfbs4" (UID: "8209d6b1-4ed7-4dda-a050-9e3122139abf") : configmap "kube-rbac-proxy" not found Jul 13 17:48:19.124639 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:19.124558 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls podName:8209d6b1-4ed7-4dda-a050-9e3122139abf nodeName:}" failed. No retries permitted until 2026-07-13 17:48:19.624546098 +0000 UTC m=+39.027345869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bfbs4" (UID: "8209d6b1-4ed7-4dda-a050-9e3122139abf") : secret "insights-runtime-extractor-tls" not found Jul 13 17:48:19.124639 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.124554 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8209d6b1-4ed7-4dda-a050-9e3122139abf-crio-socket\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:19.124639 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.124584 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8209d6b1-4ed7-4dda-a050-9e3122139abf-data-volume\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:19.128306 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.128292 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8gbm9" Jul 13 17:48:19.136646 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.136600 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z69s6\" (UniqueName: \"kubernetes.io/projected/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-api-access-z69s6\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:19.287037 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.286995 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8gbm9"] Jul 13 17:48:19.290729 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:48:19.290699 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44987d76_d577_4f20_9fd3_87e568a82b67.slice/crio-27236d119c5e91be155a8fd5ff95f712434d5e28f0dd15ad88751431b9729f53 WatchSource:0}: Error finding container 27236d119c5e91be155a8fd5ff95f712434d5e28f0dd15ad88751431b9729f53: Status 404 returned error can't find the container with id 27236d119c5e91be155a8fd5ff95f712434d5e28f0dd15ad88751431b9729f53 Jul 13 17:48:19.362951 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.362918 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv44q" event={"ID":"1ee5e9ae-8b98-4cf8-965a-ed649be3add6","Type":"ContainerStarted","Data":"46c8b8af94ce1c5508eb1b50489df830dac40e211b88d512b11c1a3852f78fdf"} Jul 13 17:48:19.364463 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.364440 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-scpjr" event={"ID":"6fd8f0fe-1073-4482-8848-ef76e7d2257f","Type":"ContainerStarted","Data":"bd9e997e94411e8109ad12c89d6feedf89867a32da56b50466ddd671c5adbda0"} Jul 13 17:48:19.365466 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.365435 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8gbm9" event={"ID":"44987d76-d577-4f20-9fd3-87e568a82b67","Type":"ContainerStarted","Data":"27236d119c5e91be155a8fd5ff95f712434d5e28f0dd15ad88751431b9729f53"} Jul 13 17:48:19.389967 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.389913 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jv44q" podStartSLOduration=7.875070385 podStartE2EDuration="38.38989715s" totalImagesPullingTime="30.514826765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:47:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:19.388321257 +0000 UTC m=+38.791121049" watchObservedRunningTime="2026-07-13 17:48:19.38989715 +0000 UTC m=+38.792696941" Jul 13 17:48:19.407148 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.407062 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-scpjr" podStartSLOduration=1.872828428 podStartE2EDuration="4.407044252s" totalImagesPullingTime="2.534215824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:19.406436273 +0000 UTC m=+38.809236066" watchObservedRunningTime="2026-07-13 17:48:19.407044252 +0000 UTC m=+38.809844043" Jul 13 17:48:19.570300 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.570206 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:19.629254 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.629214 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:19.629254 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.629255 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:19.629456 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:19.629364 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 17:48:19.629456 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:19.629381 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 17:48:19.629456 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:19.629428 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm podName:8209d6b1-4ed7-4dda-a050-9e3122139abf nodeName:}" failed. No retries permitted until 2026-07-13 17:48:20.629413541 +0000 UTC m=+40.032213309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bfbs4" (UID: "8209d6b1-4ed7-4dda-a050-9e3122139abf") : configmap "kube-rbac-proxy" not found Jul 13 17:48:19.629456 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:19.629441 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls podName:8209d6b1-4ed7-4dda-a050-9e3122139abf nodeName:}" failed. No retries permitted until 2026-07-13 17:48:20.62943509 +0000 UTC m=+40.032234857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bfbs4" (UID: "8209d6b1-4ed7-4dda-a050-9e3122139abf") : secret "insights-runtime-extractor-tls" not found Jul 13 17:48:19.677805 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.677772 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:19.830617 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:19.830512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls\") pod \"dns-default-7fr9t\" (UID: \"b1fc718c-9753-471c-963a-2ab6e27a75de\") " pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:19.830797 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:19.830696 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 17:48:19.830797 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:19.830779 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls podName:b1fc718c-9753-471c-963a-2ab6e27a75de nodeName:}" failed. No retries permitted until 2026-07-13 17:48:23.830757502 +0000 UTC m=+43.233557285 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls") pod "dns-default-7fr9t" (UID: "b1fc718c-9753-471c-963a-2ab6e27a75de") : secret "dns-default-metrics-tls" not found Jul 13 17:48:20.432720 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:20.432683 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:20.490119 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:20.490088 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:20.637949 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:20.637911 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:20.638143 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:20.637973 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:20.638143 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:20.638081 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 17:48:20.638143 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:20.638088 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 17:48:20.638274 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:20.638149 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm podName:8209d6b1-4ed7-4dda-a050-9e3122139abf nodeName:}" failed. No retries permitted until 2026-07-13 17:48:22.638129303 +0000 UTC m=+42.040929085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bfbs4" (UID: "8209d6b1-4ed7-4dda-a050-9e3122139abf") : configmap "kube-rbac-proxy" not found Jul 13 17:48:20.638274 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:20.638202 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls podName:8209d6b1-4ed7-4dda-a050-9e3122139abf nodeName:}" failed. No retries permitted until 2026-07-13 17:48:22.638181182 +0000 UTC m=+42.040980971 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bfbs4" (UID: "8209d6b1-4ed7-4dda-a050-9e3122139abf") : secret "insights-runtime-extractor-tls" not found Jul 13 17:48:20.791175 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:20.791143 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:20.887835 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:20.887801 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:20.988364 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:20.988331 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:21.045265 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:21.045174 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:21.372577 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:21.372532 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8gbm9" event={"ID":"44987d76-d577-4f20-9fd3-87e568a82b67","Type":"ContainerStarted","Data":"6d5adf535d49b33351b8b3d7925e8be1021fac394190329982183a6b2798033f"} Jul 13 17:48:21.372748 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:21.372610 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8gbm9" event={"ID":"44987d76-d577-4f20-9fd3-87e568a82b67","Type":"ContainerStarted","Data":"117b78fa8c69cf6bd93763d13fafe9e95e1bf2918ef4de50351db4c8c920070e"} Jul 13 17:48:21.448783 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:21.448747 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:21.547288 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:21.547205 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:21.866745 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:21.866669 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xvcqn_f31d603c-f23f-48fe-8f98-6b10c50684e9/dns-node-resolver/0.log" Jul 13 17:48:22.404495 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:22.404444 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8gbm9" podStartSLOduration=2.55497447 podStartE2EDuration="4.404428402s" totalImagesPullingTime="1.849453932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:22.404033894 +0000 UTC m=+41.806833685" watchObservedRunningTime="2026-07-13 17:48:22.404428402 +0000 UTC m=+41.807228192" Jul 13 17:48:22.498156 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:22.498119 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:22.597431 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:22.597400 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:22.654150 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:22.654113 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:22.654322 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:22.654155 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:22.654322 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:22.654237 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 17:48:22.654322 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:22.654286 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm podName:8209d6b1-4ed7-4dda-a050-9e3122139abf nodeName:}" failed. No retries permitted until 2026-07-13 17:48:26.654272873 +0000 UTC m=+46.057072642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bfbs4" (UID: "8209d6b1-4ed7-4dda-a050-9e3122139abf") : configmap "kube-rbac-proxy" not found Jul 13 17:48:22.654322 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:22.654285 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 17:48:22.654488 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:22.654351 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls podName:8209d6b1-4ed7-4dda-a050-9e3122139abf nodeName:}" failed. No retries permitted until 2026-07-13 17:48:26.654332273 +0000 UTC m=+46.057132041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bfbs4" (UID: "8209d6b1-4ed7-4dda-a050-9e3122139abf") : secret "insights-runtime-extractor-tls" not found Jul 13 17:48:22.865927 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:22.865899 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vqppg_3c882599-36c2-4faf-bde2-90319ddc3b8b/node-ca/0.log" Jul 13 17:48:23.053071 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.053035 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-vp7kh"] Jul 13 17:48:23.073677 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.073641 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-vp7kh"] Jul 13 17:48:23.073819 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.073739 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-vp7kh" Jul 13 17:48:23.076561 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.076523 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 13 17:48:23.076842 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.076820 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 13 17:48:23.076842 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.076839 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 13 17:48:23.077896 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.077875 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 13 17:48:23.077896 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.077881 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5vkht\"" Jul 13 17:48:23.150340 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.150252 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:23.251720 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.251688 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:23.259457 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.259424 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/27f47f98-b8eb-4dad-9509-ea6ee87e3b28-signing-key\") pod \"service-ca-79f68b9f4f-vp7kh\" (UID: \"27f47f98-b8eb-4dad-9509-ea6ee87e3b28\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vp7kh" Jul 13 17:48:23.259535 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.259488 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7nvx\" (UniqueName: \"kubernetes.io/projected/27f47f98-b8eb-4dad-9509-ea6ee87e3b28-kube-api-access-w7nvx\") pod \"service-ca-79f68b9f4f-vp7kh\" (UID: \"27f47f98-b8eb-4dad-9509-ea6ee87e3b28\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vp7kh" Jul 13 17:48:23.259581 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.259532 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/27f47f98-b8eb-4dad-9509-ea6ee87e3b28-signing-cabundle\") pod \"service-ca-79f68b9f4f-vp7kh\" (UID: \"27f47f98-b8eb-4dad-9509-ea6ee87e3b28\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vp7kh" Jul 13 17:48:23.360878 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.360839 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/27f47f98-b8eb-4dad-9509-ea6ee87e3b28-signing-key\") pod \"service-ca-79f68b9f4f-vp7kh\" (UID: \"27f47f98-b8eb-4dad-9509-ea6ee87e3b28\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vp7kh" Jul 13 17:48:23.361045 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.360908 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7nvx\" (UniqueName: \"kubernetes.io/projected/27f47f98-b8eb-4dad-9509-ea6ee87e3b28-kube-api-access-w7nvx\") pod \"service-ca-79f68b9f4f-vp7kh\" (UID: \"27f47f98-b8eb-4dad-9509-ea6ee87e3b28\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vp7kh" Jul 13 17:48:23.361045 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.360946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/27f47f98-b8eb-4dad-9509-ea6ee87e3b28-signing-cabundle\") pod \"service-ca-79f68b9f4f-vp7kh\" (UID: \"27f47f98-b8eb-4dad-9509-ea6ee87e3b28\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vp7kh" Jul 13 17:48:23.361673 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.361655 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/27f47f98-b8eb-4dad-9509-ea6ee87e3b28-signing-cabundle\") pod \"service-ca-79f68b9f4f-vp7kh\" (UID: \"27f47f98-b8eb-4dad-9509-ea6ee87e3b28\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vp7kh" Jul 13 17:48:23.363703 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.363686 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/27f47f98-b8eb-4dad-9509-ea6ee87e3b28-signing-key\") pod \"service-ca-79f68b9f4f-vp7kh\" (UID: \"27f47f98-b8eb-4dad-9509-ea6ee87e3b28\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vp7kh" Jul 13 17:48:23.373367 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.373338 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7nvx\" (UniqueName: \"kubernetes.io/projected/27f47f98-b8eb-4dad-9509-ea6ee87e3b28-kube-api-access-w7nvx\") pod \"service-ca-79f68b9f4f-vp7kh\" (UID: \"27f47f98-b8eb-4dad-9509-ea6ee87e3b28\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vp7kh" Jul 13 17:48:23.383002 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.382899 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-vp7kh" Jul 13 17:48:23.466379 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.466352 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-scpjr_6fd8f0fe-1073-4482-8848-ef76e7d2257f/serve-healthcheck-canary/0.log" Jul 13 17:48:23.540609 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.540576 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-vp7kh"] Jul 13 17:48:23.544320 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:48:23.544291 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f47f98_b8eb_4dad_9509_ea6ee87e3b28.slice/crio-4faab3be031dfd6c25e97b3d79d6ec521fd8919fdbe799968ed31b4f300439d8 WatchSource:0}: Error finding container 4faab3be031dfd6c25e97b3d79d6ec521fd8919fdbe799968ed31b4f300439d8: Status 404 returned error can't find the container with id 4faab3be031dfd6c25e97b3d79d6ec521fd8919fdbe799968ed31b4f300439d8 Jul 13 17:48:23.867149 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.867111 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls\") pod \"dns-default-7fr9t\" (UID: \"b1fc718c-9753-471c-963a-2ab6e27a75de\") " pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:23.867345 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:23.867288 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 17:48:23.867478 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:23.867365 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls podName:b1fc718c-9753-471c-963a-2ab6e27a75de nodeName:}" failed. No retries permitted until 2026-07-13 17:48:31.867341759 +0000 UTC m=+51.270141529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls") pod "dns-default-7fr9t" (UID: "b1fc718c-9753-471c-963a-2ab6e27a75de") : secret "dns-default-metrics-tls" not found Jul 13 17:48:23.868494 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:23.868473 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-8gbm9_44987d76-d577-4f20-9fd3-87e568a82b67/migrator/0.log" Jul 13 17:48:24.066013 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:24.065980 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-8gbm9_44987d76-d577-4f20-9fd3-87e568a82b67/graceful-termination/0.log" Jul 13 17:48:24.162267 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:24.162187 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:24.380923 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:24.380881 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-vp7kh" event={"ID":"27f47f98-b8eb-4dad-9509-ea6ee87e3b28","Type":"ContainerStarted","Data":"4faab3be031dfd6c25e97b3d79d6ec521fd8919fdbe799968ed31b4f300439d8"} Jul 13 17:48:26.690057 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:26.689940 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:26.690057 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:26.690018 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:26.690513 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:26.690112 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 17:48:26.690513 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:26.690176 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 17:48:26.690513 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:26.690194 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls podName:8209d6b1-4ed7-4dda-a050-9e3122139abf nodeName:}" failed. No retries permitted until 2026-07-13 17:48:34.690176551 +0000 UTC m=+54.092976338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bfbs4" (UID: "8209d6b1-4ed7-4dda-a050-9e3122139abf") : secret "insights-runtime-extractor-tls" not found Jul 13 17:48:26.690513 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:26.690248 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm podName:8209d6b1-4ed7-4dda-a050-9e3122139abf nodeName:}" failed. No retries permitted until 2026-07-13 17:48:34.690228703 +0000 UTC m=+54.093028471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bfbs4" (UID: "8209d6b1-4ed7-4dda-a050-9e3122139abf") : configmap "kube-rbac-proxy" not found Jul 13 17:48:27.222393 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:27.222350 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:27.402487 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:27.402363 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:27.403072 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:27.403030 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-vp7kh" event={"ID":"27f47f98-b8eb-4dad-9509-ea6ee87e3b28","Type":"ContainerStarted","Data":"8931afc8f727ac65fd9178784ebe7b18671399795f1a03b0e045cfe5be60d63d"} Jul 13 17:48:27.422974 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:27.422893 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-vp7kh" podStartSLOduration=1.567471539 podStartE2EDuration="4.422873248s" totalImagesPullingTime="2.855401709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:27.421336372 +0000 UTC m=+46.824136161" watchObservedRunningTime="2026-07-13 17:48:27.422873248 +0000 UTC m=+46.825673039" Jul 13 17:48:27.516850 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:27.516709 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:27.619121 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:27.619084 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:27.718461 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:27.718417 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:27.818523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:27.818474 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:27.917241 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:27.917202 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:28.110507 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:28.110381 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:29.105742 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:29.105684 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:29.290041 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:29.290001 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:29.695401 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:29.695363 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:29.854565 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:29.854536 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:29.914572 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:29.914538 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:30.096844 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:30.096802 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:30.924561 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:30.924526 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:31.254626 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:31.254522 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:31.350238 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:31.350209 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:31.490522 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:31.490487 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:31.729489 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:31.729453 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:31.831233 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:31.831186 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:31.931522 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:31.931472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls\") pod \"dns-default-7fr9t\" (UID: \"b1fc718c-9753-471c-963a-2ab6e27a75de\") " pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:31.934089 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:31.934068 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1fc718c-9753-471c-963a-2ab6e27a75de-metrics-tls\") pod \"dns-default-7fr9t\" (UID: \"b1fc718c-9753-471c-963a-2ab6e27a75de\") " pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:31.943871 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:31.943833 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:31.999301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:31.999218 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:32.004606 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:32.004582 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:32.092546 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:32.092513 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:32.156012 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:32.155973 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7fr9t"] Jul 13 17:48:32.160208 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:48:32.160180 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1fc718c_9753_471c_963a_2ab6e27a75de.slice/crio-18a5c785818fed5b8764c662c319f8140db6c65f1a6180c8551eb65347b4974b WatchSource:0}: Error finding container 18a5c785818fed5b8764c662c319f8140db6c65f1a6180c8551eb65347b4974b: Status 404 returned error can't find the container with id 18a5c785818fed5b8764c662c319f8140db6c65f1a6180c8551eb65347b4974b Jul 13 17:48:32.415834 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:32.415794 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7fr9t" event={"ID":"b1fc718c-9753-471c-963a-2ab6e27a75de","Type":"ContainerStarted","Data":"18a5c785818fed5b8764c662c319f8140db6c65f1a6180c8551eb65347b4974b"} Jul 13 17:48:33.293923 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:33.293881 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:33.493977 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:33.493925 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:33.725876 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:33.725783 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:33.785346 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:33.785303 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:33.896977 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:33.896899 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:34.092430 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:34.092394 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:34.751850 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:34.751812 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:34.751850 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:34.751853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:34.752311 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:34.752001 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 17:48:34.752311 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:48:34.752069 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls podName:8209d6b1-4ed7-4dda-a050-9e3122139abf nodeName:}" failed. No retries permitted until 2026-07-13 17:48:50.752051716 +0000 UTC m=+70.154851485 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bfbs4" (UID: "8209d6b1-4ed7-4dda-a050-9e3122139abf") : secret "insights-runtime-extractor-tls" not found Jul 13 17:48:34.752389 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:34.752331 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8209d6b1-4ed7-4dda-a050-9e3122139abf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:35.088164 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:35.088126 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:35.427237 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:35.427143 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7fr9t" event={"ID":"b1fc718c-9753-471c-963a-2ab6e27a75de","Type":"ContainerStarted","Data":"e0874221fabfb1e778cf34b03687fbc1a2a5586f7a82b2f0585ac8889eacd460"} Jul 13 17:48:35.427237 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:35.427193 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7fr9t" event={"ID":"b1fc718c-9753-471c-963a-2ab6e27a75de","Type":"ContainerStarted","Data":"bf4ded041e03f2f5f318062d61be9fe974bd570664d7f6a8ec086c891270b5c1"} Jul 13 17:48:35.427459 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:35.427283 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:35.454767 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:35.454708 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7fr9t" podStartSLOduration=17.225728369 podStartE2EDuration="19.454690195s" totalImagesPullingTime="2.228961826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:35.454373128 +0000 UTC m=+54.857172917" watchObservedRunningTime="2026-07-13 17:48:35.454690195 +0000 UTC m=+54.857489962" Jul 13 17:48:35.518687 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:35.518654 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:35.692333 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:35.692241 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:35.893027 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:35.892990 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:36.130121 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:36.130081 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:37.114445 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:37.114411 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:37.296390 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:37.296353 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:37.437104 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:37.437011 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:37.539143 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:37.539107 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:37.706106 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:37.706026 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:37.921286 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:37.921252 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:38.097600 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:38.097563 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:43.341345 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:43.341316 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n5x6m" Jul 13 17:48:45.432721 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:45.432687 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7fr9t" Jul 13 17:48:45.831249 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:45.831217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs\") pod \"network-metrics-daemon-zvwps\" (UID: \"a938d7f2-3fd3-4def-8106-4e7ae5529979\") " pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:48:45.837008 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:45.836948 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 17:48:45.843815 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:45.843782 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a938d7f2-3fd3-4def-8106-4e7ae5529979-metrics-certs\") pod \"network-metrics-daemon-zvwps\" (UID: \"a938d7f2-3fd3-4def-8106-4e7ae5529979\") " pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:48:45.860699 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:45.860667 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m566t\"" Jul 13 17:48:45.867232 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:45.867206 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvwps" Jul 13 17:48:45.932093 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:45.932023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret\") pod \"global-pull-secret-syncer-svz7l\" (UID: \"b018ff34-b64c-4dfa-acd6-af00b32f4b67\") " pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:48:45.932570 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:45.932115 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl86n\" (UniqueName: \"kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n\") pod \"network-check-target-z6nrr\" (UID: \"2a16bf86-0f45-482d-8b4f-58a84da77eb0\") " pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:48:45.943871 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:45.943840 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 17:48:45.944048 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:45.943870 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 17:48:45.955850 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:45.955816 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b018ff34-b64c-4dfa-acd6-af00b32f4b67-original-pull-secret\") pod \"global-pull-secret-syncer-svz7l\" (UID: \"b018ff34-b64c-4dfa-acd6-af00b32f4b67\") " pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:48:45.962124 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:45.962094 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 17:48:45.967064 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:45.967027 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl86n\" (UniqueName: \"kubernetes.io/projected/2a16bf86-0f45-482d-8b4f-58a84da77eb0-kube-api-access-hl86n\") pod \"network-check-target-z6nrr\" (UID: \"2a16bf86-0f45-482d-8b4f-58a84da77eb0\") " pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:48:46.007283 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.007245 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zvwps"] Jul 13 17:48:46.010513 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:48:46.010488 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda938d7f2_3fd3_4def_8106_4e7ae5529979.slice/crio-0d5d0675b9bbdadc3b5024cd7811f880b2119469da2a6fc0eac47e1e1b8cb90c WatchSource:0}: Error finding container 0d5d0675b9bbdadc3b5024cd7811f880b2119469da2a6fc0eac47e1e1b8cb90c: Status 404 returned error can't find the container with id 0d5d0675b9bbdadc3b5024cd7811f880b2119469da2a6fc0eac47e1e1b8cb90c Jul 13 17:48:46.129927 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.129850 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797cff84c4-57rgp"] Jul 13 17:48:46.132681 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.132658 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797cff84c4-57rgp" Jul 13 17:48:46.136098 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.136069 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 13 17:48:46.136289 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.136237 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 13 17:48:46.137214 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.137189 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 13 17:48:46.137346 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.137263 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 13 17:48:46.137346 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.137302 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-n2x9q\"" Jul 13 17:48:46.138105 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.138084 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2"] Jul 13 17:48:46.139995 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.139977 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2" Jul 13 17:48:46.142707 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.142691 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svz7l" Jul 13 17:48:46.143727 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.143708 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 13 17:48:46.148435 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.148406 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797cff84c4-57rgp"] Jul 13 17:48:46.150385 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.150362 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2"] Jul 13 17:48:46.153204 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.153182 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fjx6r\"" Jul 13 17:48:46.161035 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.161007 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:48:46.234691 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.234652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d8c7f2f1-d9f8-4680-98be-6daa6d8ff726-klusterlet-config\") pod \"klusterlet-addon-workmgr-6fbd6dc4fb-52zd2\" (UID: \"d8c7f2f1-d9f8-4680-98be-6daa6d8ff726\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2" Jul 13 17:48:46.234864 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.234703 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8c7f2f1-d9f8-4680-98be-6daa6d8ff726-tmp\") pod \"klusterlet-addon-workmgr-6fbd6dc4fb-52zd2\" (UID: \"d8c7f2f1-d9f8-4680-98be-6daa6d8ff726\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2" Jul 13 17:48:46.234864 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.234733 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4zwr\" (UniqueName: \"kubernetes.io/projected/d61f1bf9-01fa-49d6-90ac-06f748b99466-kube-api-access-k4zwr\") pod \"managed-serviceaccount-addon-agent-797cff84c4-57rgp\" (UID: \"d61f1bf9-01fa-49d6-90ac-06f748b99466\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797cff84c4-57rgp" Jul 13 17:48:46.234864 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.234766 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxjzf\" (UniqueName: \"kubernetes.io/projected/d8c7f2f1-d9f8-4680-98be-6daa6d8ff726-kube-api-access-zxjzf\") pod \"klusterlet-addon-workmgr-6fbd6dc4fb-52zd2\" (UID: \"d8c7f2f1-d9f8-4680-98be-6daa6d8ff726\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2" Jul 13 17:48:46.234864 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.234793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d61f1bf9-01fa-49d6-90ac-06f748b99466-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-797cff84c4-57rgp\" (UID: \"d61f1bf9-01fa-49d6-90ac-06f748b99466\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797cff84c4-57rgp" Jul 13 17:48:46.278283 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.278247 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:46.300742 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.300710 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-svz7l"] Jul 13 17:48:46.304547 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:48:46.304516 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb018ff34_b64c_4dfa_acd6_af00b32f4b67.slice/crio-49b24b2e3444a75af162201129fadd7a73a62b9aef0b9701c578b07ebbcf2801 WatchSource:0}: Error finding container 49b24b2e3444a75af162201129fadd7a73a62b9aef0b9701c578b07ebbcf2801: Status 404 returned error can't find the container with id 49b24b2e3444a75af162201129fadd7a73a62b9aef0b9701c578b07ebbcf2801 Jul 13 17:48:46.318165 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.318132 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z6nrr"] Jul 13 17:48:46.322236 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:48:46.322208 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a16bf86_0f45_482d_8b4f_58a84da77eb0.slice/crio-ebe3b1985481182fafd78c5ae8c85d95907e891b5990338ea99a02f1d07ccb44 WatchSource:0}: Error finding container ebe3b1985481182fafd78c5ae8c85d95907e891b5990338ea99a02f1d07ccb44: Status 404 returned error can't find the container with id ebe3b1985481182fafd78c5ae8c85d95907e891b5990338ea99a02f1d07ccb44 Jul 13 17:48:46.335499 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.335470 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d8c7f2f1-d9f8-4680-98be-6daa6d8ff726-klusterlet-config\") pod \"klusterlet-addon-workmgr-6fbd6dc4fb-52zd2\" (UID: \"d8c7f2f1-d9f8-4680-98be-6daa6d8ff726\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2" Jul 13 17:48:46.335669 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.335515 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8c7f2f1-d9f8-4680-98be-6daa6d8ff726-tmp\") pod \"klusterlet-addon-workmgr-6fbd6dc4fb-52zd2\" (UID: \"d8c7f2f1-d9f8-4680-98be-6daa6d8ff726\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2" Jul 13 17:48:46.335669 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.335541 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4zwr\" (UniqueName: \"kubernetes.io/projected/d61f1bf9-01fa-49d6-90ac-06f748b99466-kube-api-access-k4zwr\") pod \"managed-serviceaccount-addon-agent-797cff84c4-57rgp\" (UID: \"d61f1bf9-01fa-49d6-90ac-06f748b99466\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797cff84c4-57rgp" Jul 13 17:48:46.335669 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.335571 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxjzf\" (UniqueName: \"kubernetes.io/projected/d8c7f2f1-d9f8-4680-98be-6daa6d8ff726-kube-api-access-zxjzf\") pod \"klusterlet-addon-workmgr-6fbd6dc4fb-52zd2\" (UID: \"d8c7f2f1-d9f8-4680-98be-6daa6d8ff726\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2" Jul 13 17:48:46.335669 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.335591 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d61f1bf9-01fa-49d6-90ac-06f748b99466-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-797cff84c4-57rgp\" (UID: \"d61f1bf9-01fa-49d6-90ac-06f748b99466\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797cff84c4-57rgp" Jul 13 17:48:46.335884 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.335864 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8c7f2f1-d9f8-4680-98be-6daa6d8ff726-tmp\") pod \"klusterlet-addon-workmgr-6fbd6dc4fb-52zd2\" (UID: \"d8c7f2f1-d9f8-4680-98be-6daa6d8ff726\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2" Jul 13 17:48:46.338283 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.338255 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d61f1bf9-01fa-49d6-90ac-06f748b99466-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-797cff84c4-57rgp\" (UID: \"d61f1bf9-01fa-49d6-90ac-06f748b99466\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797cff84c4-57rgp" Jul 13 17:48:46.338389 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.338287 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d8c7f2f1-d9f8-4680-98be-6daa6d8ff726-klusterlet-config\") pod \"klusterlet-addon-workmgr-6fbd6dc4fb-52zd2\" (UID: \"d8c7f2f1-d9f8-4680-98be-6daa6d8ff726\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2" Jul 13 17:48:46.344529 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.344502 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxjzf\" (UniqueName: \"kubernetes.io/projected/d8c7f2f1-d9f8-4680-98be-6daa6d8ff726-kube-api-access-zxjzf\") pod \"klusterlet-addon-workmgr-6fbd6dc4fb-52zd2\" (UID: \"d8c7f2f1-d9f8-4680-98be-6daa6d8ff726\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2" Jul 13 17:48:46.344724 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.344705 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4zwr\" (UniqueName: \"kubernetes.io/projected/d61f1bf9-01fa-49d6-90ac-06f748b99466-kube-api-access-k4zwr\") pod \"managed-serviceaccount-addon-agent-797cff84c4-57rgp\" (UID: \"d61f1bf9-01fa-49d6-90ac-06f748b99466\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797cff84c4-57rgp" Jul 13 17:48:46.377985 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.377926 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:46.457309 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.457217 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797cff84c4-57rgp" Jul 13 17:48:46.463366 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.463325 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z6nrr" event={"ID":"2a16bf86-0f45-482d-8b4f-58a84da77eb0","Type":"ContainerStarted","Data":"ebe3b1985481182fafd78c5ae8c85d95907e891b5990338ea99a02f1d07ccb44"} Jul 13 17:48:46.464772 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.464737 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zvwps" event={"ID":"a938d7f2-3fd3-4def-8106-4e7ae5529979","Type":"ContainerStarted","Data":"0d5d0675b9bbdadc3b5024cd7811f880b2119469da2a6fc0eac47e1e1b8cb90c"} Jul 13 17:48:46.465835 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.465675 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2" Jul 13 17:48:46.465978 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.465933 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-svz7l" event={"ID":"b018ff34-b64c-4dfa-acd6-af00b32f4b67","Type":"ContainerStarted","Data":"49b24b2e3444a75af162201129fadd7a73a62b9aef0b9701c578b07ebbcf2801"} Jul 13 17:48:46.478817 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.478785 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:46.581696 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.580728 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:46.621232 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.621199 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797cff84c4-57rgp"] Jul 13 17:48:46.623668 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:48:46.623632 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd61f1bf9_01fa_49d6_90ac_06f748b99466.slice/crio-c1fa1a707c0b573eeb6152a89eb727ee7799523d021b2aa807393ceeb043064d WatchSource:0}: Error finding container c1fa1a707c0b573eeb6152a89eb727ee7799523d021b2aa807393ceeb043064d: Status 404 returned error can't find the container with id c1fa1a707c0b573eeb6152a89eb727ee7799523d021b2aa807393ceeb043064d Jul 13 17:48:46.640386 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:46.640356 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2"] Jul 13 17:48:46.643588 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:48:46.643561 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8c7f2f1_d9f8_4680_98be_6daa6d8ff726.slice/crio-1d224d70fc8db7609117702fc575be664b886a9ab4dfbbaa0ed5b8e9bd7b2d9e WatchSource:0}: Error finding container 1d224d70fc8db7609117702fc575be664b886a9ab4dfbbaa0ed5b8e9bd7b2d9e: Status 404 returned error can't find the container with id 1d224d70fc8db7609117702fc575be664b886a9ab4dfbbaa0ed5b8e9bd7b2d9e Jul 13 17:48:47.472862 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:47.472777 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2" event={"ID":"d8c7f2f1-d9f8-4680-98be-6daa6d8ff726","Type":"ContainerStarted","Data":"1d224d70fc8db7609117702fc575be664b886a9ab4dfbbaa0ed5b8e9bd7b2d9e"} Jul 13 17:48:47.476804 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:47.476041 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zvwps" event={"ID":"a938d7f2-3fd3-4def-8106-4e7ae5529979","Type":"ContainerStarted","Data":"4e61c0a8a4ea602609df01110a012a9bcaf2158841f5969b03774b5523064eec"} Jul 13 17:48:47.476804 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:47.476104 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zvwps" event={"ID":"a938d7f2-3fd3-4def-8106-4e7ae5529979","Type":"ContainerStarted","Data":"875704d14605cbec9749c096f1e477f1ba1d78b794661f896a9af1f757082456"} Jul 13 17:48:47.480592 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:47.480558 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797cff84c4-57rgp" event={"ID":"d61f1bf9-01fa-49d6-90ac-06f748b99466","Type":"ContainerStarted","Data":"c1fa1a707c0b573eeb6152a89eb727ee7799523d021b2aa807393ceeb043064d"} Jul 13 17:48:47.498062 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:47.497388 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zvwps" podStartSLOduration=65.604319194 podStartE2EDuration="1m6.497363928s" totalImagesPullingTime="893.044734ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:47.495514957 +0000 UTC m=+66.898314746" watchObservedRunningTime="2026-07-13 17:48:47.497363928 +0000 UTC m=+66.900163719" Jul 13 17:48:47.652408 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:47.652368 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:47.927636 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:47.927594 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:48.025188 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:48.025093 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:49.809387 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:49.809348 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:49.911378 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:49.911334 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:49.997737 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:49.997706 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:50.775460 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:50.775411 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:50.778289 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:50.778258 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8209d6b1-4ed7-4dda-a050-9e3122139abf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfbs4\" (UID: \"8209d6b1-4ed7-4dda-a050-9e3122139abf\") " pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:50.939358 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:50.939318 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:51.027092 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:51.027005 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t8p88\"" Jul 13 17:48:51.034447 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:51.034410 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bfbs4" Jul 13 17:48:51.037466 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:51.037437 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:51.111263 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:51.111225 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:51.394379 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:51.394345 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:53.509026 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:53.508923 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-svz7l" event={"ID":"b018ff34-b64c-4dfa-acd6-af00b32f4b67","Type":"ContainerStarted","Data":"a0daaa61e731a02a9c5eb3c9ac92095b1692605367aa04dbd8f51acfe3962b9d"} Jul 13 17:48:53.514123 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:53.514086 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2" event={"ID":"d8c7f2f1-d9f8-4680-98be-6daa6d8ff726","Type":"ContainerStarted","Data":"711a022f11754ec26ec20df5629989234e5651ad8c40a4059c9d9ffe062b1bca"} Jul 13 17:48:53.514609 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:53.514548 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2" Jul 13 17:48:53.517302 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:53.516571 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2" Jul 13 17:48:53.518468 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:53.517779 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z6nrr" event={"ID":"2a16bf86-0f45-482d-8b4f-58a84da77eb0","Type":"ContainerStarted","Data":"45a4d26c21b2b71b6d4ad41ce636c30ac02dc3ca75849e047a43e99a1fafe82c"} Jul 13 17:48:53.518468 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:53.518330 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:48:53.520359 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:53.520339 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bfbs4"] Jul 13 17:48:53.523314 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:48:53.523290 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8209d6b1_4ed7_4dda_a050_9e3122139abf.slice/crio-abd5327204f668feff446c86b49b0522c8282d784ab8d42fc1bf96467731d2d9 WatchSource:0}: Error finding container abd5327204f668feff446c86b49b0522c8282d784ab8d42fc1bf96467731d2d9: Status 404 returned error can't find the container with id abd5327204f668feff446c86b49b0522c8282d784ab8d42fc1bf96467731d2d9 Jul 13 17:48:53.530285 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:53.530241 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-svz7l" podStartSLOduration=65.464622953 podStartE2EDuration="1m12.530224438s" totalImagesPullingTime="7.065601485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:53.529488218 +0000 UTC m=+72.932288009" watchObservedRunningTime="2026-07-13 17:48:53.530224438 +0000 UTC m=+72.933024227" Jul 13 17:48:53.547859 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:53.547788 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fbd6dc4fb-52zd2" podStartSLOduration=0.805113722 podStartE2EDuration="7.547763101s" totalImagesPullingTime="6.742649379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:48:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:53.546315634 +0000 UTC m=+72.949115447" watchObservedRunningTime="2026-07-13 17:48:53.547763101 +0000 UTC m=+72.950562896" Jul 13 17:48:53.569057 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:53.568985 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z6nrr" podStartSLOduration=65.53044464 podStartE2EDuration="1m12.568950548s" totalImagesPullingTime="7.038505908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:53.567772 +0000 UTC m=+72.970571843" watchObservedRunningTime="2026-07-13 17:48:53.568950548 +0000 UTC m=+72.971750337" Jul 13 17:48:54.527535 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:54.527482 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bfbs4" event={"ID":"8209d6b1-4ed7-4dda-a050-9e3122139abf","Type":"ContainerStarted","Data":"abd5327204f668feff446c86b49b0522c8282d784ab8d42fc1bf96467731d2d9"} Jul 13 17:48:55.257837 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:55.257803 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:56.004459 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:56.004421 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:56.103790 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:56.103750 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:56.180894 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:56.180861 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:56.764205 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:56.764164 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:48:57.540921 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:57.540882 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bfbs4" event={"ID":"8209d6b1-4ed7-4dda-a050-9e3122139abf","Type":"ContainerStarted","Data":"006a141ecb60f4d5bd2c2bb8e6a6f082e8170b43abe7c6bb1a4d33c22ceb9f4b"} Jul 13 17:48:58.547411 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:58.547363 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bfbs4" event={"ID":"8209d6b1-4ed7-4dda-a050-9e3122139abf","Type":"ContainerStarted","Data":"4f087756c5c13eccb83b4515c0155f285da297704266679e266afc1d7ae7ba4c"} Jul 13 17:48:59.552733 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:59.552699 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797cff84c4-57rgp" event={"ID":"d61f1bf9-01fa-49d6-90ac-06f748b99466","Type":"ContainerStarted","Data":"029b2227cdc538d58e14336b2c39846d9c909c3b54e04a170948f791b61226dd"} Jul 13 17:48:59.581248 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:48:59.581191 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797cff84c4-57rgp" podStartSLOduration=1.098167333 podStartE2EDuration="13.581167306s" totalImagesPullingTime="12.482999973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:48:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:59.580387884 +0000 UTC m=+78.983187678" watchObservedRunningTime="2026-07-13 17:48:59.581167306 +0000 UTC m=+78.983967097" Jul 13 17:49:00.423816 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:00.423782 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:00.557639 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:00.557603 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bfbs4" event={"ID":"8209d6b1-4ed7-4dda-a050-9e3122139abf","Type":"ContainerStarted","Data":"fc8a522e45e03b401dd0b1a692007b385c2ad36d34982dd44e307fae4f340b59"} Jul 13 17:49:00.583303 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:00.583250 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bfbs4" podStartSLOduration=35.740102935 podStartE2EDuration="42.583233685s" totalImagesPullingTime="6.84313075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:48:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:49:00.582538592 +0000 UTC m=+79.985338383" watchObservedRunningTime="2026-07-13 17:49:00.583233685 +0000 UTC m=+79.986033475" Jul 13 17:49:01.237610 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:01.237566 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:01.336282 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:01.336250 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:01.434128 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:01.434095 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:01.608231 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:01.608115 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:01.706109 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:01.706079 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:01.808057 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:01.808025 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:02.092590 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.092556 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:02.199171 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.199136 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:02.328365 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.328333 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:02.422257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.422171 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:02.580398 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.580364 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:02.645985 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.645935 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nbmlv"] Jul 13 17:49:02.649164 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.649145 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.651871 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.651846 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 17:49:02.652339 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.652320 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8kwx5\"" Jul 13 17:49:02.653176 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.653157 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 17:49:02.653275 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.653156 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 17:49:02.653483 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.653465 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 17:49:02.653612 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.653596 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 17:49:02.657672 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.657433 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 17:49:02.752042 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.751936 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:02.766114 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.766078 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80bc51b3-1c87-451a-8165-b5d425ca3b78-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.766257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.766126 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/80bc51b3-1c87-451a-8165-b5d425ca3b78-root\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.766257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.766153 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/80bc51b3-1c87-451a-8165-b5d425ca3b78-node-exporter-tls\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.766257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.766174 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80bc51b3-1c87-451a-8165-b5d425ca3b78-sys\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.766257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.766194 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80bc51b3-1c87-451a-8165-b5d425ca3b78-metrics-client-ca\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.766257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.766225 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/80bc51b3-1c87-451a-8165-b5d425ca3b78-node-exporter-wtmp\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.766257 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.766252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/80bc51b3-1c87-451a-8165-b5d425ca3b78-node-exporter-textfile\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.766466 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.766332 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/80bc51b3-1c87-451a-8165-b5d425ca3b78-node-exporter-accelerators-collector-config\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.766466 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.766371 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnbmw\" (UniqueName: \"kubernetes.io/projected/80bc51b3-1c87-451a-8165-b5d425ca3b78-kube-api-access-fnbmw\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.859408 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.859373 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:02.867551 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.867522 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/80bc51b3-1c87-451a-8165-b5d425ca3b78-node-exporter-textfile\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.867746 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.867560 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/80bc51b3-1c87-451a-8165-b5d425ca3b78-node-exporter-accelerators-collector-config\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.867746 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.867578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnbmw\" (UniqueName: \"kubernetes.io/projected/80bc51b3-1c87-451a-8165-b5d425ca3b78-kube-api-access-fnbmw\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.867746 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.867617 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80bc51b3-1c87-451a-8165-b5d425ca3b78-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.867746 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.867645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/80bc51b3-1c87-451a-8165-b5d425ca3b78-root\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.867746 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.867668 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/80bc51b3-1c87-451a-8165-b5d425ca3b78-node-exporter-tls\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.867746 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.867688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80bc51b3-1c87-451a-8165-b5d425ca3b78-sys\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.867746 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.867702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80bc51b3-1c87-451a-8165-b5d425ca3b78-metrics-client-ca\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.867746 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.867725 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/80bc51b3-1c87-451a-8165-b5d425ca3b78-node-exporter-wtmp\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.868196 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.867850 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/80bc51b3-1c87-451a-8165-b5d425ca3b78-node-exporter-wtmp\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.868196 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.867930 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/80bc51b3-1c87-451a-8165-b5d425ca3b78-node-exporter-textfile\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.868196 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.868020 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/80bc51b3-1c87-451a-8165-b5d425ca3b78-root\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.868343 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.868332 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/80bc51b3-1c87-451a-8165-b5d425ca3b78-node-exporter-accelerators-collector-config\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.868678 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.868651 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80bc51b3-1c87-451a-8165-b5d425ca3b78-sys\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.869194 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.869174 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80bc51b3-1c87-451a-8165-b5d425ca3b78-metrics-client-ca\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.870875 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.870784 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/80bc51b3-1c87-451a-8165-b5d425ca3b78-node-exporter-tls\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.871494 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.871475 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80bc51b3-1c87-451a-8165-b5d425ca3b78-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.884202 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.884165 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnbmw\" (UniqueName: \"kubernetes.io/projected/80bc51b3-1c87-451a-8165-b5d425ca3b78-kube-api-access-fnbmw\") pod \"node-exporter-nbmlv\" (UID: \"80bc51b3-1c87-451a-8165-b5d425ca3b78\") " pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:02.958699 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.958663 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:02.960356 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:02.960340 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nbmlv" Jul 13 17:49:03.053736 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.053705 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:03.151264 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.151229 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:03.251737 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.251702 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:03.357429 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.357350 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:03.569693 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.569652 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nbmlv" event={"ID":"80bc51b3-1c87-451a-8165-b5d425ca3b78","Type":"ContainerStarted","Data":"def7dd480a5d1790421e9bb57e9fb4dd5f1d88e4d71ac46761ab4ad938187f93"} Jul 13 17:49:03.688043 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.687933 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:03.783369 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.783328 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:03.812473 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.812436 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 17:49:03.817897 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.817864 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.820976 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.820923 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 13 17:49:03.821784 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.821739 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 13 17:49:03.821945 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.821824 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hhdt8\"" Jul 13 17:49:03.821945 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.821882 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 13 17:49:03.822183 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.821983 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 13 17:49:03.823015 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.822995 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 13 17:49:03.823124 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.823008 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 13 17:49:03.823124 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.823054 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 13 17:49:03.823124 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.823018 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 13 17:49:03.823501 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.823482 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 13 17:49:03.831851 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.831816 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 17:49:03.878604 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.878563 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:03.881698 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.881660 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.881863 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.881710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecbc8f97-b1a5-4722-bace-df62adffba8c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.881863 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.881747 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.881863 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.881783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.881863 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.881824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.881863 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.881860 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.882092 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.881883 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-web-config\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.882092 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.881916 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ecbc8f97-b1a5-4722-bace-df62adffba8c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.882092 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.881937 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecbc8f97-b1a5-4722-bace-df62adffba8c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.882092 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.881980 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25qvb\" (UniqueName: \"kubernetes.io/projected/ecbc8f97-b1a5-4722-bace-df62adffba8c-kube-api-access-25qvb\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.882092 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.882007 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.882092 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.882031 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ecbc8f97-b1a5-4722-bace-df62adffba8c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.882092 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.882048 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ecbc8f97-b1a5-4722-bace-df62adffba8c-config-out\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.983344 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.983263 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.983344 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.983301 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecbc8f97-b1a5-4722-bace-df62adffba8c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.983344 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.983334 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.983760 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.983369 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.983760 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.983396 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.983760 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.983424 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.983760 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.983459 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-web-config\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.983760 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.983487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ecbc8f97-b1a5-4722-bace-df62adffba8c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.983760 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.983515 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecbc8f97-b1a5-4722-bace-df62adffba8c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.983760 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.983538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25qvb\" (UniqueName: \"kubernetes.io/projected/ecbc8f97-b1a5-4722-bace-df62adffba8c-kube-api-access-25qvb\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.983760 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.983564 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.983760 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.983595 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ecbc8f97-b1a5-4722-bace-df62adffba8c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.983760 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.983622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ecbc8f97-b1a5-4722-bace-df62adffba8c-config-out\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.984449 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.984208 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ecbc8f97-b1a5-4722-bace-df62adffba8c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.985001 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.984684 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecbc8f97-b1a5-4722-bace-df62adffba8c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.985001 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.984705 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecbc8f97-b1a5-4722-bace-df62adffba8c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.987410 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.987380 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.987594 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.987457 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ecbc8f97-b1a5-4722-bace-df62adffba8c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.987672 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.987601 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.987672 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.987632 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.987946 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.987926 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.988238 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.988219 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ecbc8f97-b1a5-4722-bace-df62adffba8c-config-out\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.988336 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.988314 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.988806 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.988784 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.988979 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.988940 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-web-config\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:03.995222 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:03.993234 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25qvb\" (UniqueName: \"kubernetes.io/projected/ecbc8f97-b1a5-4722-bace-df62adffba8c-kube-api-access-25qvb\") pod \"alertmanager-main-0\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:04.131690 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.131650 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:49:04.283433 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.283335 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 17:49:04.287672 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:49:04.287646 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbc8f97_b1a5_4722_bace_df62adffba8c.slice/crio-307ceff1ce831e0f36e28a89f3beba91d959f4cf079ec8c4355d8e55a0cd5c07 WatchSource:0}: Error finding container 307ceff1ce831e0f36e28a89f3beba91d959f4cf079ec8c4355d8e55a0cd5c07: Status 404 returned error can't find the container with id 307ceff1ce831e0f36e28a89f3beba91d959f4cf079ec8c4355d8e55a0cd5c07 Jul 13 17:49:04.574559 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.574522 2564 generic.go:356] "Generic (PLEG): container finished" podID="80bc51b3-1c87-451a-8165-b5d425ca3b78" containerID="c733573b7a0293b8529d47ebafeaf1c63f2f1ffcd0de12547d78f9d84162e558" exitCode=0 Jul 13 17:49:04.574763 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.574618 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nbmlv" event={"ID":"80bc51b3-1c87-451a-8165-b5d425ca3b78","Type":"ContainerDied","Data":"c733573b7a0293b8529d47ebafeaf1c63f2f1ffcd0de12547d78f9d84162e558"} Jul 13 17:49:04.575878 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.575831 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecbc8f97-b1a5-4722-bace-df62adffba8c","Type":"ContainerStarted","Data":"307ceff1ce831e0f36e28a89f3beba91d959f4cf079ec8c4355d8e55a0cd5c07"} Jul 13 17:49:04.651039 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.651016 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66f57dcb85-hg8wn"] Jul 13 17:49:04.655978 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.655942 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.659368 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.659343 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 13 17:49:04.659627 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.659596 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-9z6gb\"" Jul 13 17:49:04.659727 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.659639 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 13 17:49:04.659727 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.659601 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 13 17:49:04.659727 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.659689 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a9qndr6u5m8dp\"" Jul 13 17:49:04.659972 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.659944 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 13 17:49:04.660052 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.659949 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 13 17:49:04.670939 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.670899 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66f57dcb85-hg8wn"] Jul 13 17:49:04.791813 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.791775 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-thanos-querier-tls\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.791813 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.791815 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.792249 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.791834 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec399170-8051-4aea-9050-7935b2f50bbe-metrics-client-ca\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.792249 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.791857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkqb7\" (UniqueName: \"kubernetes.io/projected/ec399170-8051-4aea-9050-7935b2f50bbe-kube-api-access-bkqb7\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.792249 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.791893 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.792249 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.791921 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.792249 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.792030 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.792249 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.792053 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-grpc-tls\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.893277 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.893176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.893277 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.893237 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.893277 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.893282 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.893558 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.893302 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-grpc-tls\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.893558 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.893319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-thanos-querier-tls\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.893558 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.893336 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.893558 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.893354 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec399170-8051-4aea-9050-7935b2f50bbe-metrics-client-ca\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.893558 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.893380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkqb7\" (UniqueName: \"kubernetes.io/projected/ec399170-8051-4aea-9050-7935b2f50bbe-kube-api-access-bkqb7\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.894192 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.894166 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec399170-8051-4aea-9050-7935b2f50bbe-metrics-client-ca\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.896536 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.896509 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.896646 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.896613 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.896646 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.896625 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.896768 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.896751 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.896818 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.896797 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-thanos-querier-tls\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.896867 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.896854 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec399170-8051-4aea-9050-7935b2f50bbe-secret-grpc-tls\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.904906 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.904877 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkqb7\" (UniqueName: \"kubernetes.io/projected/ec399170-8051-4aea-9050-7935b2f50bbe-kube-api-access-bkqb7\") pod \"thanos-querier-66f57dcb85-hg8wn\" (UID: \"ec399170-8051-4aea-9050-7935b2f50bbe\") " pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:04.980214 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:04.980180 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:05.121217 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:05.121160 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:05.168510 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:05.168424 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66f57dcb85-hg8wn"] Jul 13 17:49:05.172998 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:49:05.172944 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec399170_8051_4aea_9050_7935b2f50bbe.slice/crio-0017aef3556575c4556edc6e00311c8c110b3f57c50ad8632f96327005b747a4 WatchSource:0}: Error finding container 0017aef3556575c4556edc6e00311c8c110b3f57c50ad8632f96327005b747a4: Status 404 returned error can't find the container with id 0017aef3556575c4556edc6e00311c8c110b3f57c50ad8632f96327005b747a4 Jul 13 17:49:05.185492 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:05.185457 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:05.583614 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:05.583071 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nbmlv" event={"ID":"80bc51b3-1c87-451a-8165-b5d425ca3b78","Type":"ContainerStarted","Data":"c38d34d70e98235a0ad34bcdb796bd1d6803827ac8883830000411ce1d856e80"} Jul 13 17:49:05.583614 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:05.583202 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nbmlv" event={"ID":"80bc51b3-1c87-451a-8165-b5d425ca3b78","Type":"ContainerStarted","Data":"928cb590bee65f6de0fb559c84e16ec1e8d63fabc9e76f7da2492606dc21dbdc"} Jul 13 17:49:05.587123 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:05.587080 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" event={"ID":"ec399170-8051-4aea-9050-7935b2f50bbe","Type":"ContainerStarted","Data":"0017aef3556575c4556edc6e00311c8c110b3f57c50ad8632f96327005b747a4"} Jul 13 17:49:05.610153 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:05.610104 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nbmlv" podStartSLOduration=2.49487814 podStartE2EDuration="3.610087252s" totalImagesPullingTime="1.038475276s" totalInitContainerRuntime="76.733836ms" isStatefulPod=true podCreationTimestamp="2026-07-13 17:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:49:05.609734109 +0000 UTC m=+85.012533903" watchObservedRunningTime="2026-07-13 17:49:05.610087252 +0000 UTC m=+85.012887039" Jul 13 17:49:05.632280 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:05.632249 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:05.729194 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:05.729154 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:05.792494 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:05.792461 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:06.166308 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:06.166214 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:06.592641 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:06.592606 2564 generic.go:356] "Generic (PLEG): container finished" podID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerID="d58f453ecad6421e8a6a02626813c9e454bac85a576a81b2ebc00b29c5e530e8" exitCode=0 Jul 13 17:49:06.592814 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:06.592687 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecbc8f97-b1a5-4722-bace-df62adffba8c","Type":"ContainerDied","Data":"d58f453ecad6421e8a6a02626813c9e454bac85a576a81b2ebc00b29c5e530e8"} Jul 13 17:49:06.766437 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:06.766395 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:06.867879 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:06.867703 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:07.067348 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.067305 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-68cc8bfbc6-45h79"] Jul 13 17:49:07.071947 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.071920 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.074868 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.074841 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 13 17:49:07.076036 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.076015 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jt5jr\"" Jul 13 17:49:07.076169 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.076133 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 13 17:49:07.076264 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.076249 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 13 17:49:07.076385 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.076369 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 13 17:49:07.076457 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.076447 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-21com578c6uc1\"" Jul 13 17:49:07.081293 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.081018 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68cc8bfbc6-45h79"] Jul 13 17:49:07.215727 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.215645 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-secret-metrics-server-tls\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.215727 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.215700 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-audit-log\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.215894 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.215767 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-metrics-server-audit-profiles\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.215894 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.215797 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jb5w\" (UniqueName: \"kubernetes.io/projected/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-kube-api-access-2jb5w\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.215894 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.215823 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-client-ca-bundle\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.216014 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.215889 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-secret-metrics-server-client-certs\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.216014 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.215925 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.316777 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.316753 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-secret-metrics-server-client-certs\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.316909 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.316786 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.317007 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.316984 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-secret-metrics-server-tls\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.317055 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.317035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-audit-log\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.317111 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.317076 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-metrics-server-audit-profiles\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.317165 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.317107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jb5w\" (UniqueName: \"kubernetes.io/projected/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-kube-api-access-2jb5w\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.317165 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.317144 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-client-ca-bundle\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.317394 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.317371 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-audit-log\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.317496 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.317474 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.318216 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.318186 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-metrics-server-audit-profiles\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.319445 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.319416 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-secret-metrics-server-client-certs\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.319557 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.319540 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-secret-metrics-server-tls\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.319920 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.319900 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-client-ca-bundle\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.326528 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.326496 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jb5w\" (UniqueName: \"kubernetes.io/projected/ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab-kube-api-access-2jb5w\") pod \"metrics-server-68cc8bfbc6-45h79\" (UID: \"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab\") " pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.364784 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.364748 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:07.385707 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.385669 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:07.467339 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.467255 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:07.547804 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.547767 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68cc8bfbc6-45h79"] Jul 13 17:49:07.550227 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.550202 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:07.550725 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:49:07.550705 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade380b7_ae9e_4b55_843e_a6c7ff0ea9ab.slice/crio-26f1d898980b8304e87d50373865fc6fcc93c06ada54a38ea09d84b271028c38 WatchSource:0}: Error finding container 26f1d898980b8304e87d50373865fc6fcc93c06ada54a38ea09d84b271028c38: Status 404 returned error can't find the container with id 26f1d898980b8304e87d50373865fc6fcc93c06ada54a38ea09d84b271028c38 Jul 13 17:49:07.598276 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.598236 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" event={"ID":"ec399170-8051-4aea-9050-7935b2f50bbe","Type":"ContainerStarted","Data":"4bbbac23f01787b88a7ef5568149e52b53c9cf9097acf322256f1205d27f96f7"} Jul 13 17:49:07.598453 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.598320 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" event={"ID":"ec399170-8051-4aea-9050-7935b2f50bbe","Type":"ContainerStarted","Data":"3d78b198ea59df8fe7ea1c0c123a99dbe47930a7677c1332d1ba06c61c4e0cd4"} Jul 13 17:49:07.598453 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.598370 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" event={"ID":"ec399170-8051-4aea-9050-7935b2f50bbe","Type":"ContainerStarted","Data":"cc3ff68945fa735f2f31dffd2345c6153eb11c679ef564e9726402d71a7acf32"} Jul 13 17:49:07.599367 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:07.599346 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" event={"ID":"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab","Type":"ContainerStarted","Data":"26f1d898980b8304e87d50373865fc6fcc93c06ada54a38ea09d84b271028c38"} Jul 13 17:49:08.127769 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:08.127728 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:08.183267 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:08.183230 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:08.891803 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:08.891761 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:08.991487 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:08.991429 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:08.995357 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:08.995332 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 17:49:08.999163 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:08.999142 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.004846 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.004821 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7cmjm\"" Jul 13 17:49:09.006180 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.006164 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 13 17:49:09.006269 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.006176 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 13 17:49:09.006333 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.006269 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 13 17:49:09.006333 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.006165 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 13 17:49:09.006434 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.006165 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ekehv4r35hfe3\"" Jul 13 17:49:09.006434 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.006282 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 13 17:49:09.006434 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.006419 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 13 17:49:09.006579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.006459 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 13 17:49:09.006579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.006566 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 13 17:49:09.007059 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.006623 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 13 17:49:09.007059 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.006689 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 13 17:49:09.007489 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.007470 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 13 17:49:09.007870 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.007853 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 13 17:49:09.009775 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.009743 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 13 17:49:09.011558 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.011540 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 13 17:49:09.020770 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.020732 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 17:49:09.054360 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.054337 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:09.133324 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.133293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.133946 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.133915 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-web-config\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.134086 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.134071 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.134209 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.134196 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.134326 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.134311 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.134436 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.134423 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.134559 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.134544 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.134699 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.134684 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.134839 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.134826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.135024 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.135009 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.135224 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.135210 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-config\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.135350 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.135336 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f4766386-91d0-4ee7-9e8f-5f4581324cc7-config-out\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.135584 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.135568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmhqf\" (UniqueName: \"kubernetes.io/projected/f4766386-91d0-4ee7-9e8f-5f4581324cc7-kube-api-access-cmhqf\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.135705 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.135691 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.135821 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.135807 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f4766386-91d0-4ee7-9e8f-5f4581324cc7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.135935 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.135923 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.136046 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.136032 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.136168 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.136155 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.136302 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.136278 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.136492 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.136473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.237221 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.237350 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.237350 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237265 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-web-config\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.237350 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237289 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.237350 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237323 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.237350 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237346 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.237604 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237369 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.237604 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237397 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.237604 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.237604 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237448 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.237604 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.237604 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237502 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-config\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.237604 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237524 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f4766386-91d0-4ee7-9e8f-5f4581324cc7-config-out\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.237604 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237563 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmhqf\" (UniqueName: \"kubernetes.io/projected/f4766386-91d0-4ee7-9e8f-5f4581324cc7-kube-api-access-cmhqf\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.238044 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237634 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.238044 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237671 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f4766386-91d0-4ee7-9e8f-5f4581324cc7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.238044 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237708 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.238044 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237732 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.238044 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.238044 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.237792 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.238760 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.238487 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.238760 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.238747 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.238930 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.238783 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.239978 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.239278 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.239978 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.239276 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.239978 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.239618 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.239978 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.239699 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.241619 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.241592 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.242381 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.242254 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f4766386-91d0-4ee7-9e8f-5f4581324cc7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.242741 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.242671 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.244462 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.244432 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f4766386-91d0-4ee7-9e8f-5f4581324cc7-config-out\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.248309 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.247814 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.248309 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.247838 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.248309 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.248271 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.251419 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.250553 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.251547 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.251436 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.251628 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.251606 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-config\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.253281 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.253238 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-web-config\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.253447 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.253420 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.255168 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.255146 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmhqf\" (UniqueName: \"kubernetes.io/projected/f4766386-91d0-4ee7-9e8f-5f4581324cc7-kube-api-access-cmhqf\") pod \"prometheus-k8s-0\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.312037 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.311997 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:09.484539 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.484506 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 17:49:09.488894 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:49:09.488864 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4766386_91d0_4ee7_9e8f_5f4581324cc7.slice/crio-5bd230802841437ffc9d405c726db0713fd3daf8af63f7b2073d4e395722a3fa WatchSource:0}: Error finding container 5bd230802841437ffc9d405c726db0713fd3daf8af63f7b2073d4e395722a3fa: Status 404 returned error can't find the container with id 5bd230802841437ffc9d405c726db0713fd3daf8af63f7b2073d4e395722a3fa Jul 13 17:49:09.611188 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.611153 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecbc8f97-b1a5-4722-bace-df62adffba8c","Type":"ContainerStarted","Data":"48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31"} Jul 13 17:49:09.611391 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.611258 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecbc8f97-b1a5-4722-bace-df62adffba8c","Type":"ContainerStarted","Data":"bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092"} Jul 13 17:49:09.611391 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.611293 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecbc8f97-b1a5-4722-bace-df62adffba8c","Type":"ContainerStarted","Data":"a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68"} Jul 13 17:49:09.611391 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.611322 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecbc8f97-b1a5-4722-bace-df62adffba8c","Type":"ContainerStarted","Data":"61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e"} Jul 13 17:49:09.611391 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.611355 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecbc8f97-b1a5-4722-bace-df62adffba8c","Type":"ContainerStarted","Data":"98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b"} Jul 13 17:49:09.611611 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.611393 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecbc8f97-b1a5-4722-bace-df62adffba8c","Type":"ContainerStarted","Data":"1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40"} Jul 13 17:49:09.614424 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.614389 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" event={"ID":"ec399170-8051-4aea-9050-7935b2f50bbe","Type":"ContainerStarted","Data":"49c316dbfa187af364a11478dbddd0f54e2f65267f56d1760092339c40a760ff"} Jul 13 17:49:09.614602 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.614465 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" event={"ID":"ec399170-8051-4aea-9050-7935b2f50bbe","Type":"ContainerStarted","Data":"3b4f932144e5a3499df306d7758b59aaeab436a12e60056d0f0b92d6cdabf3a1"} Jul 13 17:49:09.614602 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.614512 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" event={"ID":"ec399170-8051-4aea-9050-7935b2f50bbe","Type":"ContainerStarted","Data":"45323dade08a2f3e35e024eb1aa31832834fe23ff6b55a7026252bd03eac39c4"} Jul 13 17:49:09.614602 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.614547 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:09.615974 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.615938 2564 generic.go:356] "Generic (PLEG): container finished" podID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerID="c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670" exitCode=0 Jul 13 17:49:09.616088 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.615986 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4766386-91d0-4ee7-9e8f-5f4581324cc7","Type":"ContainerDied","Data":"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670"} Jul 13 17:49:09.616088 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.616061 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4766386-91d0-4ee7-9e8f-5f4581324cc7","Type":"ContainerStarted","Data":"5bd230802841437ffc9d405c726db0713fd3daf8af63f7b2073d4e395722a3fa"} Jul 13 17:49:09.617760 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.617738 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" event={"ID":"ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab","Type":"ContainerStarted","Data":"09bcbc0dc81840554586b9760922c6b3e5dfba0fcb72f7053044771afddc6081"} Jul 13 17:49:09.649280 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.649165 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.978826426 podStartE2EDuration="6.64914842s" totalImagesPullingTime="3.646200636s" totalInitContainerRuntime="24.121358ms" isStatefulPod=false podCreationTimestamp="2026-07-13 17:49:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:49:09.646993733 +0000 UTC m=+89.049793524" watchObservedRunningTime="2026-07-13 17:49:09.64914842 +0000 UTC m=+89.051948209" Jul 13 17:49:09.738770 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.738713 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" podStartSLOduration=2.132288826 podStartE2EDuration="5.738693991s" totalImagesPullingTime="3.606405165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:49:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:49:09.737301324 +0000 UTC m=+89.140101114" watchObservedRunningTime="2026-07-13 17:49:09.738693991 +0000 UTC m=+89.141493803" Jul 13 17:49:09.758746 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:09.758690 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" podStartSLOduration=1.2985605310000001 podStartE2EDuration="2.758672727s" totalImagesPullingTime="1.460112196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:49:09.757698668 +0000 UTC m=+89.160498465" watchObservedRunningTime="2026-07-13 17:49:09.758672727 +0000 UTC m=+89.161472516" Jul 13 17:49:13.124088 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:13.124019 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:13.287781 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:13.287612 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:13.640060 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:13.640020 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4766386-91d0-4ee7-9e8f-5f4581324cc7","Type":"ContainerStarted","Data":"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18"} Jul 13 17:49:13.640245 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:13.640131 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4766386-91d0-4ee7-9e8f-5f4581324cc7","Type":"ContainerStarted","Data":"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f"} Jul 13 17:49:13.640245 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:13.640159 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4766386-91d0-4ee7-9e8f-5f4581324cc7","Type":"ContainerStarted","Data":"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e"} Jul 13 17:49:13.640245 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:13.640181 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4766386-91d0-4ee7-9e8f-5f4581324cc7","Type":"ContainerStarted","Data":"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f"} Jul 13 17:49:13.640245 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:13.640211 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4766386-91d0-4ee7-9e8f-5f4581324cc7","Type":"ContainerStarted","Data":"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d"} Jul 13 17:49:13.640245 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:13.640235 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4766386-91d0-4ee7-9e8f-5f4581324cc7","Type":"ContainerStarted","Data":"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da"} Jul 13 17:49:13.677246 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:13.677192 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.286773762 podStartE2EDuration="5.677173844s" totalImagesPullingTime="3.370538827s" totalInitContainerRuntime="19.861255ms" isStatefulPod=false podCreationTimestamp="2026-07-13 17:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:49:13.674781525 +0000 UTC m=+93.077581306" watchObservedRunningTime="2026-07-13 17:49:13.677173844 +0000 UTC m=+93.079973633" Jul 13 17:49:14.312370 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:14.312332 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:49:14.428722 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:14.428692 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:14.530209 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:14.530170 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:14.598697 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:14.598614 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:15.630936 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:15.630905 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66f57dcb85-hg8wn" Jul 13 17:49:15.847634 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:15.847590 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:15.910775 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:15.910689 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:18.189498 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:18.189458 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:18.245219 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:18.245189 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:19.738219 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:19.738188 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:19.878622 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:19.878588 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:21.852788 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:21.852738 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:21.913459 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:21.913377 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:22.441292 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:22.441254 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:22.500204 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:22.500171 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:25.535288 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:25.535259 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z6nrr" Jul 13 17:49:27.386425 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:27.386393 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:27.386917 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:27.386484 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:31.142585 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:31.142549 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:31.242498 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:31.242464 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:31.694186 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:31.694144 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:36.086674 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:36.086632 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:37.441544 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:37.441505 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:37.495423 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:37.495382 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:49:47.391849 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:47.391816 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:49:47.395829 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:49:47.395799 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-68cc8bfbc6-45h79" Jul 13 17:50:09.313175 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:09.313130 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:09.333564 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:09.333530 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:09.868583 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:09.868554 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:21.911543 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:21.911448 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:50:22.467789 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:22.467752 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:50:23.018310 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:23.018265 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 17:50:23.018785 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:23.018649 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="alertmanager" containerID="cri-o://1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40" gracePeriod=120 Jul 13 17:50:23.018785 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:23.018693 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="kube-rbac-proxy-metric" containerID="cri-o://bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092" gracePeriod=120 Jul 13 17:50:23.018785 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:23.018727 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="kube-rbac-proxy-web" containerID="cri-o://61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e" gracePeriod=120 Jul 13 17:50:23.018942 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:23.018764 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="config-reloader" containerID="cri-o://98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b" gracePeriod=120 Jul 13 17:50:23.018942 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:23.018799 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="kube-rbac-proxy" containerID="cri-o://a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68" gracePeriod=120 Jul 13 17:50:23.018942 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:23.018785 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="prom-label-proxy" containerID="cri-o://48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31" gracePeriod=120 Jul 13 17:50:23.913191 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:23.913159 2564 generic.go:356] "Generic (PLEG): container finished" podID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerID="48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31" exitCode=0 Jul 13 17:50:23.913191 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:23.913183 2564 generic.go:356] "Generic (PLEG): container finished" podID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerID="a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68" exitCode=0 Jul 13 17:50:23.913191 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:23.913189 2564 generic.go:356] "Generic (PLEG): container finished" podID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerID="98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b" exitCode=0 Jul 13 17:50:23.913191 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:23.913195 2564 generic.go:356] "Generic (PLEG): container finished" podID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerID="1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40" exitCode=0 Jul 13 17:50:23.913463 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:23.913239 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecbc8f97-b1a5-4722-bace-df62adffba8c","Type":"ContainerDied","Data":"48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31"} Jul 13 17:50:23.913463 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:23.913306 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecbc8f97-b1a5-4722-bace-df62adffba8c","Type":"ContainerDied","Data":"a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68"} Jul 13 17:50:23.913463 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:23.913333 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecbc8f97-b1a5-4722-bace-df62adffba8c","Type":"ContainerDied","Data":"98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b"} Jul 13 17:50:23.913463 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:23.913357 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecbc8f97-b1a5-4722-bace-df62adffba8c","Type":"ContainerDied","Data":"1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40"} Jul 13 17:50:24.263649 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.263622 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:24.279103 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.279077 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-config-volume\") pod \"ecbc8f97-b1a5-4722-bace-df62adffba8c\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " Jul 13 17:50:24.279266 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.279113 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-cluster-tls-config\") pod \"ecbc8f97-b1a5-4722-bace-df62adffba8c\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " Jul 13 17:50:24.279266 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.279149 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecbc8f97-b1a5-4722-bace-df62adffba8c-metrics-client-ca\") pod \"ecbc8f97-b1a5-4722-bace-df62adffba8c\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " Jul 13 17:50:24.279266 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.279180 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecbc8f97-b1a5-4722-bace-df62adffba8c-alertmanager-trusted-ca-bundle\") pod \"ecbc8f97-b1a5-4722-bace-df62adffba8c\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " Jul 13 17:50:24.279384 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.279353 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"ecbc8f97-b1a5-4722-bace-df62adffba8c\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " Jul 13 17:50:24.279442 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.279398 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-main-tls\") pod \"ecbc8f97-b1a5-4722-bace-df62adffba8c\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " Jul 13 17:50:24.279442 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.279433 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25qvb\" (UniqueName: \"kubernetes.io/projected/ecbc8f97-b1a5-4722-bace-df62adffba8c-kube-api-access-25qvb\") pod \"ecbc8f97-b1a5-4722-bace-df62adffba8c\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " Jul 13 17:50:24.279542 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.279462 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy\") pod \"ecbc8f97-b1a5-4722-bace-df62adffba8c\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " Jul 13 17:50:24.279542 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.279513 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-web-config\") pod \"ecbc8f97-b1a5-4722-bace-df62adffba8c\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " Jul 13 17:50:24.279642 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.279534 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecbc8f97-b1a5-4722-bace-df62adffba8c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ecbc8f97-b1a5-4722-bace-df62adffba8c" (UID: "ecbc8f97-b1a5-4722-bace-df62adffba8c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:50:24.279642 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.279553 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecbc8f97-b1a5-4722-bace-df62adffba8c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ecbc8f97-b1a5-4722-bace-df62adffba8c" (UID: "ecbc8f97-b1a5-4722-bace-df62adffba8c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:50:24.279642 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.279540 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ecbc8f97-b1a5-4722-bace-df62adffba8c-alertmanager-main-db\") pod \"ecbc8f97-b1a5-4722-bace-df62adffba8c\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " Jul 13 17:50:24.279642 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.279608 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ecbc8f97-b1a5-4722-bace-df62adffba8c-config-out\") pod \"ecbc8f97-b1a5-4722-bace-df62adffba8c\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " Jul 13 17:50:24.279642 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.279636 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ecbc8f97-b1a5-4722-bace-df62adffba8c-tls-assets\") pod \"ecbc8f97-b1a5-4722-bace-df62adffba8c\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " Jul 13 17:50:24.279886 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.279816 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecbc8f97-b1a5-4722-bace-df62adffba8c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ecbc8f97-b1a5-4722-bace-df62adffba8c" (UID: "ecbc8f97-b1a5-4722-bace-df62adffba8c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:50:24.279886 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.279874 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ecbc8f97-b1a5-4722-bace-df62adffba8c\" (UID: \"ecbc8f97-b1a5-4722-bace-df62adffba8c\") " Jul 13 17:50:24.280778 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.280424 2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecbc8f97-b1a5-4722-bace-df62adffba8c-metrics-client-ca\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:24.280778 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.280450 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecbc8f97-b1a5-4722-bace-df62adffba8c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:24.280778 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.280465 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ecbc8f97-b1a5-4722-bace-df62adffba8c-alertmanager-main-db\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:24.282698 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.282638 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-config-volume" (OuterVolumeSpecName: "config-volume") pod "ecbc8f97-b1a5-4722-bace-df62adffba8c" (UID: "ecbc8f97-b1a5-4722-bace-df62adffba8c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:50:24.282817 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.282735 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ecbc8f97-b1a5-4722-bace-df62adffba8c" (UID: "ecbc8f97-b1a5-4722-bace-df62adffba8c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:50:24.282926 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.282839 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ecbc8f97-b1a5-4722-bace-df62adffba8c" (UID: "ecbc8f97-b1a5-4722-bace-df62adffba8c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:50:24.283330 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.283303 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ecbc8f97-b1a5-4722-bace-df62adffba8c" (UID: "ecbc8f97-b1a5-4722-bace-df62adffba8c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:50:24.283404 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.283348 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecbc8f97-b1a5-4722-bace-df62adffba8c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ecbc8f97-b1a5-4722-bace-df62adffba8c" (UID: "ecbc8f97-b1a5-4722-bace-df62adffba8c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:50:24.283514 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.283494 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ecbc8f97-b1a5-4722-bace-df62adffba8c" (UID: "ecbc8f97-b1a5-4722-bace-df62adffba8c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:50:24.284322 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.284294 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecbc8f97-b1a5-4722-bace-df62adffba8c-kube-api-access-25qvb" (OuterVolumeSpecName: "kube-api-access-25qvb") pod "ecbc8f97-b1a5-4722-bace-df62adffba8c" (UID: "ecbc8f97-b1a5-4722-bace-df62adffba8c"). InnerVolumeSpecName "kube-api-access-25qvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:50:24.284514 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.284490 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecbc8f97-b1a5-4722-bace-df62adffba8c-config-out" (OuterVolumeSpecName: "config-out") pod "ecbc8f97-b1a5-4722-bace-df62adffba8c" (UID: "ecbc8f97-b1a5-4722-bace-df62adffba8c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:50:24.287401 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.287379 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ecbc8f97-b1a5-4722-bace-df62adffba8c" (UID: "ecbc8f97-b1a5-4722-bace-df62adffba8c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:50:24.294553 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.294519 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-web-config" (OuterVolumeSpecName: "web-config") pod "ecbc8f97-b1a5-4722-bace-df62adffba8c" (UID: "ecbc8f97-b1a5-4722-bace-df62adffba8c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:50:24.381218 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.381183 2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-cluster-tls-config\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:24.381218 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.381215 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:24.381218 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.381226 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-main-tls\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:24.381443 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.381235 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25qvb\" (UniqueName: \"kubernetes.io/projected/ecbc8f97-b1a5-4722-bace-df62adffba8c-kube-api-access-25qvb\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:24.381443 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.381244 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:24.381443 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.381252 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-web-config\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:24.381443 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.381261 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ecbc8f97-b1a5-4722-bace-df62adffba8c-config-out\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:24.381443 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.381268 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ecbc8f97-b1a5-4722-bace-df62adffba8c-tls-assets\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:24.381443 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.381275 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:24.381443 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.381284 2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ecbc8f97-b1a5-4722-bace-df62adffba8c-config-volume\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:24.920521 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.920487 2564 generic.go:356] "Generic (PLEG): container finished" podID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerID="bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092" exitCode=0 Jul 13 17:50:24.920521 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.920515 2564 generic.go:356] "Generic (PLEG): container finished" podID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerID="61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e" exitCode=0 Jul 13 17:50:24.920747 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.920557 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecbc8f97-b1a5-4722-bace-df62adffba8c","Type":"ContainerDied","Data":"bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092"} Jul 13 17:50:24.920747 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.920582 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:24.920747 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.920645 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecbc8f97-b1a5-4722-bace-df62adffba8c","Type":"ContainerDied","Data":"61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e"} Jul 13 17:50:24.920747 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.920674 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecbc8f97-b1a5-4722-bace-df62adffba8c","Type":"ContainerDied","Data":"307ceff1ce831e0f36e28a89f3beba91d959f4cf079ec8c4355d8e55a0cd5c07"} Jul 13 17:50:24.920747 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.920703 2564 scope.go:117] "RemoveContainer" containerID="48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31" Jul 13 17:50:24.929308 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.929283 2564 scope.go:117] "RemoveContainer" containerID="bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092" Jul 13 17:50:24.937643 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.937623 2564 scope.go:117] "RemoveContainer" containerID="a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68" Jul 13 17:50:24.945219 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.945188 2564 scope.go:117] "RemoveContainer" containerID="61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e" Jul 13 17:50:24.953879 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.953852 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 17:50:24.953971 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.953910 2564 scope.go:117] "RemoveContainer" containerID="98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b" Jul 13 17:50:24.962447 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.962426 2564 scope.go:117] "RemoveContainer" containerID="1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40" Jul 13 17:50:24.963557 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.963537 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 17:50:24.970416 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.970394 2564 scope.go:117] "RemoveContainer" containerID="d58f453ecad6421e8a6a02626813c9e454bac85a576a81b2ebc00b29c5e530e8" Jul 13 17:50:24.978328 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.978305 2564 scope.go:117] "RemoveContainer" containerID="48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31" Jul 13 17:50:24.978682 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:50:24.978656 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31\": container with ID starting with 48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31 not found: ID does not exist" containerID="48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31" Jul 13 17:50:24.978739 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.978693 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31"} err="failed to get container status \"48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31\": rpc error: code = NotFound desc = could not find container \"48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31\": container with ID starting with 48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31 not found: ID does not exist" Jul 13 17:50:24.978739 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.978729 2564 scope.go:117] "RemoveContainer" containerID="bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092" Jul 13 17:50:24.979051 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:50:24.979032 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092\": container with ID starting with bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092 not found: ID does not exist" containerID="bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092" Jul 13 17:50:24.979124 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.979061 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092"} err="failed to get container status \"bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092\": rpc error: code = NotFound desc = could not find container \"bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092\": container with ID starting with bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092 not found: ID does not exist" Jul 13 17:50:24.979124 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.979084 2564 scope.go:117] "RemoveContainer" containerID="a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68" Jul 13 17:50:24.979336 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:50:24.979317 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68\": container with ID starting with a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68 not found: ID does not exist" containerID="a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68" Jul 13 17:50:24.979398 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.979343 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68"} err="failed to get container status \"a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68\": rpc error: code = NotFound desc = could not find container \"a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68\": container with ID starting with a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68 not found: ID does not exist" Jul 13 17:50:24.979398 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.979363 2564 scope.go:117] "RemoveContainer" containerID="61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e" Jul 13 17:50:24.979596 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:50:24.979580 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e\": container with ID starting with 61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e not found: ID does not exist" containerID="61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e" Jul 13 17:50:24.979633 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.979601 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e"} err="failed to get container status \"61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e\": rpc error: code = NotFound desc = could not find container \"61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e\": container with ID starting with 61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e not found: ID does not exist" Jul 13 17:50:24.979633 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.979625 2564 scope.go:117] "RemoveContainer" containerID="98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b" Jul 13 17:50:24.979874 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:50:24.979860 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b\": container with ID starting with 98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b not found: ID does not exist" containerID="98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b" Jul 13 17:50:24.979914 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.979878 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b"} err="failed to get container status \"98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b\": rpc error: code = NotFound desc = could not find container \"98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b\": container with ID starting with 98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b not found: ID does not exist" Jul 13 17:50:24.979914 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.979897 2564 scope.go:117] "RemoveContainer" containerID="1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40" Jul 13 17:50:24.980116 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:50:24.980100 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40\": container with ID starting with 1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40 not found: ID does not exist" containerID="1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40" Jul 13 17:50:24.980159 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.980119 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40"} err="failed to get container status \"1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40\": rpc error: code = NotFound desc = could not find container \"1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40\": container with ID starting with 1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40 not found: ID does not exist" Jul 13 17:50:24.980159 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.980134 2564 scope.go:117] "RemoveContainer" containerID="d58f453ecad6421e8a6a02626813c9e454bac85a576a81b2ebc00b29c5e530e8" Jul 13 17:50:24.980303 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:50:24.980283 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d58f453ecad6421e8a6a02626813c9e454bac85a576a81b2ebc00b29c5e530e8\": container with ID starting with d58f453ecad6421e8a6a02626813c9e454bac85a576a81b2ebc00b29c5e530e8 not found: ID does not exist" containerID="d58f453ecad6421e8a6a02626813c9e454bac85a576a81b2ebc00b29c5e530e8" Jul 13 17:50:24.980369 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.980312 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d58f453ecad6421e8a6a02626813c9e454bac85a576a81b2ebc00b29c5e530e8"} err="failed to get container status \"d58f453ecad6421e8a6a02626813c9e454bac85a576a81b2ebc00b29c5e530e8\": rpc error: code = NotFound desc = could not find container \"d58f453ecad6421e8a6a02626813c9e454bac85a576a81b2ebc00b29c5e530e8\": container with ID starting with d58f453ecad6421e8a6a02626813c9e454bac85a576a81b2ebc00b29c5e530e8 not found: ID does not exist" Jul 13 17:50:24.980369 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.980333 2564 scope.go:117] "RemoveContainer" containerID="48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31" Jul 13 17:50:24.980584 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.980568 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31"} err="failed to get container status \"48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31\": rpc error: code = NotFound desc = could not find container \"48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31\": container with ID starting with 48bee2b0ce74bd44b6660056d62313fae82fb8387fdf03663e95449b15546a31 not found: ID does not exist" Jul 13 17:50:24.980625 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.980584 2564 scope.go:117] "RemoveContainer" containerID="bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092" Jul 13 17:50:24.980770 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.980755 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092"} err="failed to get container status \"bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092\": rpc error: code = NotFound desc = could not find container \"bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092\": container with ID starting with bc71542f7d60a8a1952724a7a570740a9a6ad84e2b28383c2b8dfa78bd7a6092 not found: ID does not exist" Jul 13 17:50:24.980813 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.980770 2564 scope.go:117] "RemoveContainer" containerID="a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68" Jul 13 17:50:24.980944 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.980929 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68"} err="failed to get container status \"a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68\": rpc error: code = NotFound desc = could not find container \"a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68\": container with ID starting with a6d57f322d310067c081e70d4cdcfb264d34ef1a6f522e62ce646b5a14be7f68 not found: ID does not exist" Jul 13 17:50:24.981030 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.980944 2564 scope.go:117] "RemoveContainer" containerID="61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e" Jul 13 17:50:24.981168 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.981140 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e"} err="failed to get container status \"61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e\": rpc error: code = NotFound desc = could not find container \"61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e\": container with ID starting with 61dc697743d911c38cec0851cdf2b810faaf52982d48ba97de37685e588c714e not found: ID does not exist" Jul 13 17:50:24.981209 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.981169 2564 scope.go:117] "RemoveContainer" containerID="98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b" Jul 13 17:50:24.981375 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.981359 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b"} err="failed to get container status \"98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b\": rpc error: code = NotFound desc = could not find container \"98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b\": container with ID starting with 98dfa89331ba83b45dece4907297b7cf1e412a236fb144d1e52ae0846b0f017b not found: ID does not exist" Jul 13 17:50:24.981467 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.981375 2564 scope.go:117] "RemoveContainer" containerID="1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40" Jul 13 17:50:24.981569 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.981554 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40"} err="failed to get container status \"1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40\": rpc error: code = NotFound desc = could not find container \"1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40\": container with ID starting with 1f27a76e081165ae5217a43307252c930b30f89f545bda568e70dcf6f4ce6a40 not found: ID does not exist" Jul 13 17:50:24.981606 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.981570 2564 scope.go:117] "RemoveContainer" containerID="d58f453ecad6421e8a6a02626813c9e454bac85a576a81b2ebc00b29c5e530e8" Jul 13 17:50:24.981779 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.981764 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d58f453ecad6421e8a6a02626813c9e454bac85a576a81b2ebc00b29c5e530e8"} err="failed to get container status \"d58f453ecad6421e8a6a02626813c9e454bac85a576a81b2ebc00b29c5e530e8\": rpc error: code = NotFound desc = could not find container \"d58f453ecad6421e8a6a02626813c9e454bac85a576a81b2ebc00b29c5e530e8\": container with ID starting with d58f453ecad6421e8a6a02626813c9e454bac85a576a81b2ebc00b29c5e530e8 not found: ID does not exist" Jul 13 17:50:24.996019 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.995990 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 17:50:24.996283 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996272 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="config-reloader" Jul 13 17:50:24.996326 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996285 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="config-reloader" Jul 13 17:50:24.996326 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996295 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="kube-rbac-proxy-metric" Jul 13 17:50:24.996326 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996301 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="kube-rbac-proxy-metric" Jul 13 17:50:24.996326 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996313 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="init-config-reloader" Jul 13 17:50:24.996326 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996319 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="init-config-reloader" Jul 13 17:50:24.996467 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996326 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="alertmanager" Jul 13 17:50:24.996467 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996334 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="alertmanager" Jul 13 17:50:24.996467 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996342 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="kube-rbac-proxy-web" Jul 13 17:50:24.996467 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996348 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="kube-rbac-proxy-web" Jul 13 17:50:24.996467 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996355 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="prom-label-proxy" Jul 13 17:50:24.996467 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996360 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="prom-label-proxy" Jul 13 17:50:24.996467 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996371 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="kube-rbac-proxy" Jul 13 17:50:24.996467 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996376 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="kube-rbac-proxy" Jul 13 17:50:24.996467 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996431 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="config-reloader" Jul 13 17:50:24.996467 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996439 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="prom-label-proxy" Jul 13 17:50:24.996467 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996446 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="kube-rbac-proxy" Jul 13 17:50:24.996467 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996451 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="kube-rbac-proxy-web" Jul 13 17:50:24.996467 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996456 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="kube-rbac-proxy-metric" Jul 13 17:50:24.996467 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.996461 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" containerName="alertmanager" Jul 13 17:50:24.999885 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:24.999867 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.003056 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.003033 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 13 17:50:25.003194 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.003082 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 13 17:50:25.003357 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.003342 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 13 17:50:25.003439 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.003426 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hhdt8\"" Jul 13 17:50:25.003498 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.003429 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 13 17:50:25.003551 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.003493 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 13 17:50:25.003601 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.003559 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 13 17:50:25.003827 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.003812 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 13 17:50:25.004307 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.004290 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 13 17:50:25.009620 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.009601 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 13 17:50:25.025869 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.025834 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 17:50:25.087875 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.087838 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a713f17-bf18-4a6d-b088-c792adc3c143-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.087875 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.087881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-config-volume\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.088127 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.087900 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.088127 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.087968 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.088127 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.088013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cq6m\" (UniqueName: \"kubernetes.io/projected/5a713f17-bf18-4a6d-b088-c792adc3c143-kube-api-access-7cq6m\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.088127 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.088034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a713f17-bf18-4a6d-b088-c792adc3c143-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.088127 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.088052 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.088127 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.088087 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a713f17-bf18-4a6d-b088-c792adc3c143-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.088127 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.088106 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.088377 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.088134 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.088377 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.088201 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5a713f17-bf18-4a6d-b088-c792adc3c143-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.088377 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.088220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a713f17-bf18-4a6d-b088-c792adc3c143-config-out\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.088377 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.088242 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-web-config\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.136922 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.136879 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecbc8f97-b1a5-4722-bace-df62adffba8c" path="/var/lib/kubelet/pods/ecbc8f97-b1a5-4722-bace-df62adffba8c/volumes" Jul 13 17:50:25.189139 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.189043 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cq6m\" (UniqueName: \"kubernetes.io/projected/5a713f17-bf18-4a6d-b088-c792adc3c143-kube-api-access-7cq6m\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.189139 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.189097 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a713f17-bf18-4a6d-b088-c792adc3c143-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.189139 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.189125 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.189396 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.189185 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a713f17-bf18-4a6d-b088-c792adc3c143-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.189396 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.189212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.189396 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.189236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.189396 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.189285 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5a713f17-bf18-4a6d-b088-c792adc3c143-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.189396 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.189313 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a713f17-bf18-4a6d-b088-c792adc3c143-config-out\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.189396 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.189359 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-web-config\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.189396 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.189393 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a713f17-bf18-4a6d-b088-c792adc3c143-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.189729 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.189446 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-config-volume\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.189729 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.189478 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.189729 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.189510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.190282 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.190008 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5a713f17-bf18-4a6d-b088-c792adc3c143-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.190282 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.190229 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a713f17-bf18-4a6d-b088-c792adc3c143-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.191280 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.191249 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a713f17-bf18-4a6d-b088-c792adc3c143-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.192895 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.192603 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.192895 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.192809 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.193141 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.192927 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.193141 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.193001 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.193343 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.193310 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a713f17-bf18-4a6d-b088-c792adc3c143-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.194501 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.194483 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a713f17-bf18-4a6d-b088-c792adc3c143-config-out\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.194769 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.194741 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-config-volume\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.194835 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.194740 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.195047 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.195029 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a713f17-bf18-4a6d-b088-c792adc3c143-web-config\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.204023 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.203995 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cq6m\" (UniqueName: \"kubernetes.io/projected/5a713f17-bf18-4a6d-b088-c792adc3c143-kube-api-access-7cq6m\") pod \"alertmanager-main-0\" (UID: \"5a713f17-bf18-4a6d-b088-c792adc3c143\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.309556 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.309515 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 17:50:25.474887 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.474863 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 17:50:25.476267 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:50:25.476243 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a713f17_bf18_4a6d_b088_c792adc3c143.slice/crio-39dba6fe3c94d9641758ef9b59227fb2569c5cfc56c5965ad4e166d35d4a1e72 WatchSource:0}: Error finding container 39dba6fe3c94d9641758ef9b59227fb2569c5cfc56c5965ad4e166d35d4a1e72: Status 404 returned error can't find the container with id 39dba6fe3c94d9641758ef9b59227fb2569c5cfc56c5965ad4e166d35d4a1e72 Jul 13 17:50:25.927633 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.927596 2564 generic.go:356] "Generic (PLEG): container finished" podID="5a713f17-bf18-4a6d-b088-c792adc3c143" containerID="9157ec5c4e384bf5afebe2c95a5ad053a71db1f5a863b3eb12e28a487d1a7a18" exitCode=0 Jul 13 17:50:25.927802 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.927645 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a713f17-bf18-4a6d-b088-c792adc3c143","Type":"ContainerDied","Data":"9157ec5c4e384bf5afebe2c95a5ad053a71db1f5a863b3eb12e28a487d1a7a18"} Jul 13 17:50:25.927802 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:25.927701 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a713f17-bf18-4a6d-b088-c792adc3c143","Type":"ContainerStarted","Data":"39dba6fe3c94d9641758ef9b59227fb2569c5cfc56c5965ad4e166d35d4a1e72"} Jul 13 17:50:26.934949 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:26.934912 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a713f17-bf18-4a6d-b088-c792adc3c143","Type":"ContainerStarted","Data":"be458b6549b3781600c67cd27dedb693a3a920912329de312ef9be5cb3b9f930"} Jul 13 17:50:26.935509 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:26.935045 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a713f17-bf18-4a6d-b088-c792adc3c143","Type":"ContainerStarted","Data":"e9bd2c7a0c2f9b2a5dc908905e108477f6aa52bbec2e00ecba4215bd80bbffb5"} Jul 13 17:50:26.935509 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:26.935098 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a713f17-bf18-4a6d-b088-c792adc3c143","Type":"ContainerStarted","Data":"3c7425461d457fa6074f6047561f943fdc3baf6a1d8ebe04360021d9b7689cb9"} Jul 13 17:50:26.935509 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:26.935124 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a713f17-bf18-4a6d-b088-c792adc3c143","Type":"ContainerStarted","Data":"4394d07550a58a84b16d499c19e3d144ed0df3eb35f804ed1de8847ed52f84bf"} Jul 13 17:50:26.935509 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:26.935147 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a713f17-bf18-4a6d-b088-c792adc3c143","Type":"ContainerStarted","Data":"050d4d61fb5b020f7a986e8484a7d75e5e437c3741697d5c597101a07b3b6e4b"} Jul 13 17:50:26.935509 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:26.935177 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a713f17-bf18-4a6d-b088-c792adc3c143","Type":"ContainerStarted","Data":"7bfa95ec0544776b1dd9d64d0d2f705b2873ea48e19176ba862c301e1817c3c3"} Jul 13 17:50:26.969787 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:26.969728 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.9498484510000003 podStartE2EDuration="2.969710611s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.86216ms" isStatefulPod=false podCreationTimestamp="2026-07-13 17:50:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:50:26.967192589 +0000 UTC m=+166.369992359" watchObservedRunningTime="2026-07-13 17:50:26.969710611 +0000 UTC m=+166.372510401" Jul 13 17:50:27.317608 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.317572 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 17:50:27.317999 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.317885 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="prometheus" containerID="cri-o://bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da" gracePeriod=600 Jul 13 17:50:27.317999 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.317903 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="kube-rbac-proxy" containerID="cri-o://91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f" gracePeriod=600 Jul 13 17:50:27.317999 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.317929 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="thanos-sidecar" containerID="cri-o://3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f" gracePeriod=600 Jul 13 17:50:27.317999 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.317983 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="config-reloader" containerID="cri-o://a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d" gracePeriod=600 Jul 13 17:50:27.318274 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.317988 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18" gracePeriod=600 Jul 13 17:50:27.318274 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.318040 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="kube-rbac-proxy-web" containerID="cri-o://af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e" gracePeriod=600 Jul 13 17:50:27.567804 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.567736 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:27.611363 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.611334 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-db\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.611540 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.611375 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmhqf\" (UniqueName: \"kubernetes.io/projected/f4766386-91d0-4ee7-9e8f-5f4581324cc7-kube-api-access-cmhqf\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.611540 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.611405 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-thanos-prometheus-http-client-file\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.611540 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.611432 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f4766386-91d0-4ee7-9e8f-5f4581324cc7-config-out\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.611540 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.611482 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.611763 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.611687 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-kubelet-serving-ca-bundle\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.611763 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.611726 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-serving-certs-ca-bundle\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.611863 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.611770 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-web-config\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.611863 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.611795 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-trusted-ca-bundle\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.611863 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.611835 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-kube-rbac-proxy\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.612030 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.611861 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-metrics-client-certs\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.612030 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.611894 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f4766386-91d0-4ee7-9e8f-5f4581324cc7-tls-assets\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.612030 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.611919 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-metrics-client-ca\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.612030 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.611969 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-2\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.612783 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.612688 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:50:27.613244 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.613045 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:50:27.613244 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.613108 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.613244 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.613143 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-1\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.613244 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.613186 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-0\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.613506 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.613249 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-tls\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.613506 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.613294 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-grpc-tls\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.613506 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.613320 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-config\") pod \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\" (UID: \"f4766386-91d0-4ee7-9e8f-5f4581324cc7\") " Jul 13 17:50:27.613665 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.613592 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-db\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.613665 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.613613 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.613665 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.613318 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:50:27.613665 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.613573 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:50:27.613913 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.613887 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:50:27.613992 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.613897 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:50:27.614504 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.614404 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4766386-91d0-4ee7-9e8f-5f4581324cc7-kube-api-access-cmhqf" (OuterVolumeSpecName: "kube-api-access-cmhqf") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "kube-api-access-cmhqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:50:27.615135 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.615096 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:50:27.616791 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.616749 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:50:27.617561 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.617532 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:50:27.617652 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.617606 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:50:27.618277 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.618248 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-config" (OuterVolumeSpecName: "config") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:50:27.618424 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.618397 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:50:27.618636 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.618596 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:50:27.618809 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.618756 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:50:27.618888 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.618845 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4766386-91d0-4ee7-9e8f-5f4581324cc7-config-out" (OuterVolumeSpecName: "config-out") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:50:27.619246 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.619226 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:50:27.619557 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.619540 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:50:27.619634 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.619563 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4766386-91d0-4ee7-9e8f-5f4581324cc7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:50:27.629128 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.629085 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-web-config" (OuterVolumeSpecName: "web-config") pod "f4766386-91d0-4ee7-9e8f-5f4581324cc7" (UID: "f4766386-91d0-4ee7-9e8f-5f4581324cc7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:50:27.714673 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714614 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.714673 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714663 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.714673 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714674 2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-grpc-tls\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.714673 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714686 2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-config\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.714673 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714694 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmhqf\" (UniqueName: \"kubernetes.io/projected/f4766386-91d0-4ee7-9e8f-5f4581324cc7-kube-api-access-cmhqf\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.715003 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714704 2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.715003 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714713 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f4766386-91d0-4ee7-9e8f-5f4581324cc7-config-out\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.715003 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714722 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.715003 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714731 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.715003 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714739 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-web-config\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.715003 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714747 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.715003 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714755 2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-kube-rbac-proxy\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.715003 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714763 2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-metrics-client-certs\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.715003 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714773 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f4766386-91d0-4ee7-9e8f-5f4581324cc7-tls-assets\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.715003 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714780 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-configmap-metrics-client-ca\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.715003 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714788 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.715003 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714796 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f4766386-91d0-4ee7-9e8f-5f4581324cc7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.715003 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.714804 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f4766386-91d0-4ee7-9e8f-5f4581324cc7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-21.ec2.internal\" DevicePath \"\"" Jul 13 17:50:27.943071 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.942980 2564 generic.go:356] "Generic (PLEG): container finished" podID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerID="1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18" exitCode=0 Jul 13 17:50:27.943071 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.943007 2564 generic.go:356] "Generic (PLEG): container finished" podID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerID="91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f" exitCode=0 Jul 13 17:50:27.943071 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.943014 2564 generic.go:356] "Generic (PLEG): container finished" podID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerID="af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e" exitCode=0 Jul 13 17:50:27.943071 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.943021 2564 generic.go:356] "Generic (PLEG): container finished" podID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerID="3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f" exitCode=0 Jul 13 17:50:27.943071 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.943027 2564 generic.go:356] "Generic (PLEG): container finished" podID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerID="a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d" exitCode=0 Jul 13 17:50:27.943071 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.943033 2564 generic.go:356] "Generic (PLEG): container finished" podID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerID="bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da" exitCode=0 Jul 13 17:50:27.943071 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.943069 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:27.943686 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.943066 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4766386-91d0-4ee7-9e8f-5f4581324cc7","Type":"ContainerDied","Data":"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18"} Jul 13 17:50:27.943686 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.943212 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4766386-91d0-4ee7-9e8f-5f4581324cc7","Type":"ContainerDied","Data":"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f"} Jul 13 17:50:27.943686 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.943243 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4766386-91d0-4ee7-9e8f-5f4581324cc7","Type":"ContainerDied","Data":"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e"} Jul 13 17:50:27.943686 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.943267 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4766386-91d0-4ee7-9e8f-5f4581324cc7","Type":"ContainerDied","Data":"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f"} Jul 13 17:50:27.943686 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.943285 2564 scope.go:117] "RemoveContainer" containerID="1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18" Jul 13 17:50:27.943686 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.943292 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4766386-91d0-4ee7-9e8f-5f4581324cc7","Type":"ContainerDied","Data":"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d"} Jul 13 17:50:27.943686 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.943317 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4766386-91d0-4ee7-9e8f-5f4581324cc7","Type":"ContainerDied","Data":"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da"} Jul 13 17:50:27.943686 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.943340 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f4766386-91d0-4ee7-9e8f-5f4581324cc7","Type":"ContainerDied","Data":"5bd230802841437ffc9d405c726db0713fd3daf8af63f7b2073d4e395722a3fa"} Jul 13 17:50:27.952112 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.952092 2564 scope.go:117] "RemoveContainer" containerID="91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f" Jul 13 17:50:27.959639 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.959619 2564 scope.go:117] "RemoveContainer" containerID="af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e" Jul 13 17:50:27.966704 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.966684 2564 scope.go:117] "RemoveContainer" containerID="3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f" Jul 13 17:50:27.971270 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.971242 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 17:50:27.975710 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.975682 2564 scope.go:117] "RemoveContainer" containerID="a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d" Jul 13 17:50:27.976253 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.976234 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 17:50:27.983260 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.983241 2564 scope.go:117] "RemoveContainer" containerID="bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da" Jul 13 17:50:27.991091 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.991069 2564 scope.go:117] "RemoveContainer" containerID="c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670" Jul 13 17:50:27.998853 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.998833 2564 scope.go:117] "RemoveContainer" containerID="1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18" Jul 13 17:50:27.999231 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:50:27.999212 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18\": container with ID starting with 1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18 not found: ID does not exist" containerID="1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18" Jul 13 17:50:27.999314 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.999241 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18"} err="failed to get container status \"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18\": rpc error: code = NotFound desc = could not find container \"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18\": container with ID starting with 1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18 not found: ID does not exist" Jul 13 17:50:27.999314 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.999260 2564 scope.go:117] "RemoveContainer" containerID="91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f" Jul 13 17:50:27.999525 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:50:27.999498 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f\": container with ID starting with 91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f not found: ID does not exist" containerID="91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f" Jul 13 17:50:27.999566 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.999532 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f"} err="failed to get container status \"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f\": rpc error: code = NotFound desc = could not find container \"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f\": container with ID starting with 91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f not found: ID does not exist" Jul 13 17:50:27.999566 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.999550 2564 scope.go:117] "RemoveContainer" containerID="af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e" Jul 13 17:50:27.999816 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:50:27.999798 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e\": container with ID starting with af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e not found: ID does not exist" containerID="af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e" Jul 13 17:50:27.999876 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.999824 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e"} err="failed to get container status \"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e\": rpc error: code = NotFound desc = could not find container \"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e\": container with ID starting with af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e not found: ID does not exist" Jul 13 17:50:27.999876 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:27.999846 2564 scope.go:117] "RemoveContainer" containerID="3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f" Jul 13 17:50:28.000141 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:50:28.000120 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f\": container with ID starting with 3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f not found: ID does not exist" containerID="3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f" Jul 13 17:50:28.000241 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.000143 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f"} err="failed to get container status \"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f\": rpc error: code = NotFound desc = could not find container \"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f\": container with ID starting with 3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f not found: ID does not exist" Jul 13 17:50:28.000241 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.000157 2564 scope.go:117] "RemoveContainer" containerID="a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d" Jul 13 17:50:28.000410 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:50:28.000392 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d\": container with ID starting with a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d not found: ID does not exist" containerID="a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d" Jul 13 17:50:28.000449 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.000417 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d"} err="failed to get container status \"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d\": rpc error: code = NotFound desc = could not find container \"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d\": container with ID starting with a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d not found: ID does not exist" Jul 13 17:50:28.000449 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.000432 2564 scope.go:117] "RemoveContainer" containerID="bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da" Jul 13 17:50:28.000655 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:50:28.000640 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da\": container with ID starting with bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da not found: ID does not exist" containerID="bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da" Jul 13 17:50:28.000706 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.000660 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da"} err="failed to get container status \"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da\": rpc error: code = NotFound desc = could not find container \"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da\": container with ID starting with bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da not found: ID does not exist" Jul 13 17:50:28.000706 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.000673 2564 scope.go:117] "RemoveContainer" containerID="c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670" Jul 13 17:50:28.000876 ip-10-0-138-21 kubenswrapper[2564]: E0713 17:50:28.000861 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670\": container with ID starting with c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670 not found: ID does not exist" containerID="c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670" Jul 13 17:50:28.000915 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.000880 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670"} err="failed to get container status \"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670\": rpc error: code = NotFound desc = could not find container \"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670\": container with ID starting with c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670 not found: ID does not exist" Jul 13 17:50:28.000915 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.000894 2564 scope.go:117] "RemoveContainer" containerID="1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18" Jul 13 17:50:28.001108 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.001091 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18"} err="failed to get container status \"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18\": rpc error: code = NotFound desc = could not find container \"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18\": container with ID starting with 1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18 not found: ID does not exist" Jul 13 17:50:28.001179 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.001107 2564 scope.go:117] "RemoveContainer" containerID="91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f" Jul 13 17:50:28.001312 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.001297 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f"} err="failed to get container status \"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f\": rpc error: code = NotFound desc = could not find container \"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f\": container with ID starting with 91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f not found: ID does not exist" Jul 13 17:50:28.001312 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.001311 2564 scope.go:117] "RemoveContainer" containerID="af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e" Jul 13 17:50:28.001516 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.001503 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e"} err="failed to get container status \"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e\": rpc error: code = NotFound desc = could not find container \"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e\": container with ID starting with af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e not found: ID does not exist" Jul 13 17:50:28.001561 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.001516 2564 scope.go:117] "RemoveContainer" containerID="3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f" Jul 13 17:50:28.001726 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.001703 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f"} err="failed to get container status \"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f\": rpc error: code = NotFound desc = could not find container \"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f\": container with ID starting with 3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f not found: ID does not exist" Jul 13 17:50:28.001775 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.001727 2564 scope.go:117] "RemoveContainer" containerID="a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d" Jul 13 17:50:28.001929 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.001905 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d"} err="failed to get container status \"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d\": rpc error: code = NotFound desc = could not find container \"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d\": container with ID starting with a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d not found: ID does not exist" Jul 13 17:50:28.001994 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.001933 2564 scope.go:117] "RemoveContainer" containerID="bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da" Jul 13 17:50:28.002161 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.002146 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da"} err="failed to get container status \"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da\": rpc error: code = NotFound desc = could not find container \"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da\": container with ID starting with bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da not found: ID does not exist" Jul 13 17:50:28.002211 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.002160 2564 scope.go:117] "RemoveContainer" containerID="c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670" Jul 13 17:50:28.002328 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.002313 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670"} err="failed to get container status \"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670\": rpc error: code = NotFound desc = could not find container \"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670\": container with ID starting with c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670 not found: ID does not exist" Jul 13 17:50:28.002393 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.002336 2564 scope.go:117] "RemoveContainer" containerID="1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18" Jul 13 17:50:28.002564 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.002545 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18"} err="failed to get container status \"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18\": rpc error: code = NotFound desc = could not find container \"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18\": container with ID starting with 1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18 not found: ID does not exist" Jul 13 17:50:28.002627 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.002565 2564 scope.go:117] "RemoveContainer" containerID="91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f" Jul 13 17:50:28.003008 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.002982 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f"} err="failed to get container status \"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f\": rpc error: code = NotFound desc = could not find container \"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f\": container with ID starting with 91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f not found: ID does not exist" Jul 13 17:50:28.003117 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.003010 2564 scope.go:117] "RemoveContainer" containerID="af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e" Jul 13 17:50:28.003443 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.003359 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e"} err="failed to get container status \"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e\": rpc error: code = NotFound desc = could not find container \"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e\": container with ID starting with af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e not found: ID does not exist" Jul 13 17:50:28.003443 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.003386 2564 scope.go:117] "RemoveContainer" containerID="3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f" Jul 13 17:50:28.003652 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.003629 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f"} err="failed to get container status \"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f\": rpc error: code = NotFound desc = could not find container \"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f\": container with ID starting with 3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f not found: ID does not exist" Jul 13 17:50:28.003694 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.003654 2564 scope.go:117] "RemoveContainer" containerID="a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d" Jul 13 17:50:28.003880 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.003864 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d"} err="failed to get container status \"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d\": rpc error: code = NotFound desc = could not find container \"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d\": container with ID starting with a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d not found: ID does not exist" Jul 13 17:50:28.003920 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.003882 2564 scope.go:117] "RemoveContainer" containerID="bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da" Jul 13 17:50:28.004179 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.004159 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da"} err="failed to get container status \"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da\": rpc error: code = NotFound desc = could not find container \"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da\": container with ID starting with bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da not found: ID does not exist" Jul 13 17:50:28.004179 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.004179 2564 scope.go:117] "RemoveContainer" containerID="c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670" Jul 13 17:50:28.004996 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.004805 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670"} err="failed to get container status \"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670\": rpc error: code = NotFound desc = could not find container \"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670\": container with ID starting with c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670 not found: ID does not exist" Jul 13 17:50:28.004996 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.004851 2564 scope.go:117] "RemoveContainer" containerID="1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.005777 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006421 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="prometheus" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006440 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="prometheus" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006466 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="thanos-sidecar" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006475 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="thanos-sidecar" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006500 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="config-reloader" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006509 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="config-reloader" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006520 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="kube-rbac-proxy" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006529 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="kube-rbac-proxy" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006553 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="kube-rbac-proxy-web" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006561 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="kube-rbac-proxy-web" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006579 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="init-config-reloader" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006587 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="init-config-reloader" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006596 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="kube-rbac-proxy-thanos" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006604 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="kube-rbac-proxy-thanos" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006719 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="prometheus" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006731 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="thanos-sidecar" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006742 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="config-reloader" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006757 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="kube-rbac-proxy" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006774 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="kube-rbac-proxy-web" Jul 13 17:50:28.009579 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.006783 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" containerName="kube-rbac-proxy-thanos" Jul 13 17:50:28.010422 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.010184 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18"} err="failed to get container status \"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18\": rpc error: code = NotFound desc = could not find container \"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18\": container with ID starting with 1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18 not found: ID does not exist" Jul 13 17:50:28.010422 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.010214 2564 scope.go:117] "RemoveContainer" containerID="91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f" Jul 13 17:50:28.010515 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.010478 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f"} err="failed to get container status \"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f\": rpc error: code = NotFound desc = could not find container \"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f\": container with ID starting with 91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f not found: ID does not exist" Jul 13 17:50:28.010515 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.010498 2564 scope.go:117] "RemoveContainer" containerID="af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e" Jul 13 17:50:28.010757 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.010738 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e"} err="failed to get container status \"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e\": rpc error: code = NotFound desc = could not find container \"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e\": container with ID starting with af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e not found: ID does not exist" Jul 13 17:50:28.010810 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.010758 2564 scope.go:117] "RemoveContainer" containerID="3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f" Jul 13 17:50:28.011009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.010991 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f"} err="failed to get container status \"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f\": rpc error: code = NotFound desc = could not find container \"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f\": container with ID starting with 3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f not found: ID does not exist" Jul 13 17:50:28.011009 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.011009 2564 scope.go:117] "RemoveContainer" containerID="a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d" Jul 13 17:50:28.011221 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.011197 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d"} err="failed to get container status \"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d\": rpc error: code = NotFound desc = could not find container \"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d\": container with ID starting with a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d not found: ID does not exist" Jul 13 17:50:28.011291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.011223 2564 scope.go:117] "RemoveContainer" containerID="bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da" Jul 13 17:50:28.011523 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.011492 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da"} err="failed to get container status \"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da\": rpc error: code = NotFound desc = could not find container \"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da\": container with ID starting with bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da not found: ID does not exist" Jul 13 17:50:28.011570 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.011525 2564 scope.go:117] "RemoveContainer" containerID="c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670" Jul 13 17:50:28.011899 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.011871 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670"} err="failed to get container status \"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670\": rpc error: code = NotFound desc = could not find container \"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670\": container with ID starting with c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670 not found: ID does not exist" Jul 13 17:50:28.011949 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.011902 2564 scope.go:117] "RemoveContainer" containerID="1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18" Jul 13 17:50:28.012174 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.012156 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18"} err="failed to get container status \"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18\": rpc error: code = NotFound desc = could not find container \"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18\": container with ID starting with 1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18 not found: ID does not exist" Jul 13 17:50:28.012259 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.012177 2564 scope.go:117] "RemoveContainer" containerID="91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f" Jul 13 17:50:28.012398 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.012377 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f"} err="failed to get container status \"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f\": rpc error: code = NotFound desc = could not find container \"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f\": container with ID starting with 91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f not found: ID does not exist" Jul 13 17:50:28.012398 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.012395 2564 scope.go:117] "RemoveContainer" containerID="af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e" Jul 13 17:50:28.012582 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.012566 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.012636 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.012606 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e"} err="failed to get container status \"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e\": rpc error: code = NotFound desc = could not find container \"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e\": container with ID starting with af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e not found: ID does not exist" Jul 13 17:50:28.012636 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.012621 2564 scope.go:117] "RemoveContainer" containerID="3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f" Jul 13 17:50:28.013052 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.013023 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f"} err="failed to get container status \"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f\": rpc error: code = NotFound desc = could not find container \"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f\": container with ID starting with 3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f not found: ID does not exist" Jul 13 17:50:28.013052 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.013052 2564 scope.go:117] "RemoveContainer" containerID="a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d" Jul 13 17:50:28.013295 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.013274 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d"} err="failed to get container status \"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d\": rpc error: code = NotFound desc = could not find container \"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d\": container with ID starting with a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d not found: ID does not exist" Jul 13 17:50:28.013349 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.013298 2564 scope.go:117] "RemoveContainer" containerID="bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da" Jul 13 17:50:28.013543 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.013524 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da"} err="failed to get container status \"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da\": rpc error: code = NotFound desc = could not find container \"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da\": container with ID starting with bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da not found: ID does not exist" Jul 13 17:50:28.013590 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.013545 2564 scope.go:117] "RemoveContainer" containerID="c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670" Jul 13 17:50:28.013781 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.013762 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670"} err="failed to get container status \"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670\": rpc error: code = NotFound desc = could not find container \"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670\": container with ID starting with c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670 not found: ID does not exist" Jul 13 17:50:28.013829 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.013783 2564 scope.go:117] "RemoveContainer" containerID="1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18" Jul 13 17:50:28.014020 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.014003 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18"} err="failed to get container status \"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18\": rpc error: code = NotFound desc = could not find container \"1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18\": container with ID starting with 1c8dad5ebba21c65e08a7e3262298358775c018d74df88cfab2e5878d7e65b18 not found: ID does not exist" Jul 13 17:50:28.014090 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.014019 2564 scope.go:117] "RemoveContainer" containerID="91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f" Jul 13 17:50:28.014238 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.014223 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f"} err="failed to get container status \"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f\": rpc error: code = NotFound desc = could not find container \"91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f\": container with ID starting with 91f0268f81be9869253bedc12d5910dead2db5c6fc2fc896e7503e373165b12f not found: ID does not exist" Jul 13 17:50:28.014296 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.014239 2564 scope.go:117] "RemoveContainer" containerID="af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e" Jul 13 17:50:28.014504 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.014485 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e"} err="failed to get container status \"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e\": rpc error: code = NotFound desc = could not find container \"af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e\": container with ID starting with af06f7e46b91bd0cd7e6835a2cdebe2f994dcfc468b8007862a5836cd3dd280e not found: ID does not exist" Jul 13 17:50:28.014560 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.014505 2564 scope.go:117] "RemoveContainer" containerID="3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f" Jul 13 17:50:28.014803 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.014782 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f"} err="failed to get container status \"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f\": rpc error: code = NotFound desc = could not find container \"3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f\": container with ID starting with 3d15da24c10031c8bb7ba4e354125830731a39faaa425a882904203f79776a0f not found: ID does not exist" Jul 13 17:50:28.014803 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.014803 2564 scope.go:117] "RemoveContainer" containerID="a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d" Jul 13 17:50:28.015061 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.015042 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d"} err="failed to get container status \"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d\": rpc error: code = NotFound desc = could not find container \"a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d\": container with ID starting with a2ab790aaeea709e0d2fe9fbdc17871819635bb655734ae9762e3745b401704d not found: ID does not exist" Jul 13 17:50:28.015132 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.015062 2564 scope.go:117] "RemoveContainer" containerID="bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da" Jul 13 17:50:28.015342 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.015321 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da"} err="failed to get container status \"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da\": rpc error: code = NotFound desc = could not find container \"bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da\": container with ID starting with bd1764a600d84206ace100a0eed47d0e01d59e62c872d00bb9d0ae991ec172da not found: ID does not exist" Jul 13 17:50:28.015402 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.015342 2564 scope.go:117] "RemoveContainer" containerID="c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670" Jul 13 17:50:28.015607 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.015558 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670"} err="failed to get container status \"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670\": rpc error: code = NotFound desc = could not find container \"c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670\": container with ID starting with c6cf64319377424689d47a22a17236868bcd25bca0f070fa2bc89d725d640670 not found: ID does not exist" Jul 13 17:50:28.018042 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.018023 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 13 17:50:28.018151 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.018118 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 13 17:50:28.018461 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.018444 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 13 17:50:28.018547 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.018450 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 13 17:50:28.018547 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.018462 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 13 17:50:28.018657 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.018575 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 13 17:50:28.018816 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.018799 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 13 17:50:28.018880 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.018806 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ekehv4r35hfe3\"" Jul 13 17:50:28.019094 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.019079 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 13 17:50:28.019408 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.019388 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 13 17:50:28.019500 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.019407 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 13 17:50:28.019500 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.019428 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7cmjm\"" Jul 13 17:50:28.019500 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.019394 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 13 17:50:28.019500 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.019397 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 13 17:50:28.024563 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.024544 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 13 17:50:28.025561 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.025547 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 13 17:50:28.032595 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.032564 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 17:50:28.118441 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118403 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.118441 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118440 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.118660 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.118660 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118484 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.118660 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118510 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnwdx\" (UniqueName: \"kubernetes.io/projected/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-kube-api-access-fnwdx\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.118660 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118547 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.118660 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.118660 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118624 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.118660 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118656 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-config-out\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.118855 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118678 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.118855 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118705 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.118855 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.118855 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118763 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.118855 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118798 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-web-config\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.118855 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.118855 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118837 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.119105 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118859 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-config\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.119105 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118875 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.119105 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118890 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.119105 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.118925 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.220291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.220215 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.220291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.220257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.220291 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.220278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.220544 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.220325 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-config-out\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.220544 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.220356 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.220544 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.220383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.220544 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.220409 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.220544 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.220435 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.221184 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.221161 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.221292 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.221222 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-web-config\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.221292 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.221273 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.221508 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.221300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.221508 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.221324 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.221722 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.221697 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.221907 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.221887 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.222005 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.221333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-config\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.222005 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.221949 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.222116 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.222021 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.222116 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.222029 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.222116 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.222109 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.222267 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.222179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.222267 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.222209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.222267 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.222257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.222408 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.222285 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.222408 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.222329 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnwdx\" (UniqueName: \"kubernetes.io/projected/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-kube-api-access-fnwdx\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.223627 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.223593 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-config-out\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.223731 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.223599 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.223818 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.223797 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.224079 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.224049 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-web-config\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.224315 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.224282 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.224671 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.224643 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.224757 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.224655 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.224988 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.224945 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.225601 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.225574 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.225927 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.225908 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.226528 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.226502 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-config\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.226625 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.226605 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.227000 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.226982 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.227075 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.226984 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.232988 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.232950 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnwdx\" (UniqueName: \"kubernetes.io/projected/9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0-kube-api-access-fnwdx\") pod \"prometheus-k8s-0\" (UID: \"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.322641 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.322609 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:28.470650 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.470564 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 17:50:28.474343 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:50:28.474313 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc4a4af_ffb3_4d7f_85d9_a9bf9c253df0.slice/crio-edcb611b4e2af9f87ff6b9e8ebee37ec1694d65d4c2cb59ffbe54fcccc7753e9 WatchSource:0}: Error finding container edcb611b4e2af9f87ff6b9e8ebee37ec1694d65d4c2cb59ffbe54fcccc7753e9: Status 404 returned error can't find the container with id edcb611b4e2af9f87ff6b9e8ebee37ec1694d65d4c2cb59ffbe54fcccc7753e9 Jul 13 17:50:28.949589 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.949557 2564 generic.go:356] "Generic (PLEG): container finished" podID="9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0" containerID="f742b1519cd27121b25c1a0bf618ef1d4ca26a42fbb5fe14ff1d895aaff08175" exitCode=0 Jul 13 17:50:28.949997 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.949621 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0","Type":"ContainerDied","Data":"f742b1519cd27121b25c1a0bf618ef1d4ca26a42fbb5fe14ff1d895aaff08175"} Jul 13 17:50:28.949997 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:28.949671 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0","Type":"ContainerStarted","Data":"edcb611b4e2af9f87ff6b9e8ebee37ec1694d65d4c2cb59ffbe54fcccc7753e9"} Jul 13 17:50:29.142205 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:29.142162 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4766386-91d0-4ee7-9e8f-5f4581324cc7" path="/var/lib/kubelet/pods/f4766386-91d0-4ee7-9e8f-5f4581324cc7/volumes" Jul 13 17:50:29.957149 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:29.957108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0","Type":"ContainerStarted","Data":"8d8450a95a7e138f87c12b1c283df3b05579f3aa8bcb37e3716a980498eb7506"} Jul 13 17:50:29.957575 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:29.957223 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0","Type":"ContainerStarted","Data":"d986cb3381332c8310d03b81670d5531b3d72edbd934cf8fa8ed001d6c6d96f1"} Jul 13 17:50:29.957575 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:29.957266 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0","Type":"ContainerStarted","Data":"bf80ea1eeb0ed4505c382c2ed93b04ddc2eb5b09d2a9a0f3aa72154cdb4a7830"} Jul 13 17:50:29.957575 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:29.957311 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0","Type":"ContainerStarted","Data":"704e27b81eb02bd65ac52771d013f71c80bca58711686dec9751ab7d2f765a87"} Jul 13 17:50:29.957575 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:29.957349 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0","Type":"ContainerStarted","Data":"abadf774cdb8f2b59a0b3d97a5a505e05eda59556772600cc2a9c72bf57b3c20"} Jul 13 17:50:29.957575 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:29.957387 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0","Type":"ContainerStarted","Data":"4ead675c33697b74c79d59c6797139f84f98d16eed923b34f17069b7981edd8b"} Jul 13 17:50:29.995862 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:29.995807 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.9751594839999997 podStartE2EDuration="2.995788397s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.628913ms" isStatefulPod=false podCreationTimestamp="2026-07-13 17:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:50:29.993042149 +0000 UTC m=+169.395841940" watchObservedRunningTime="2026-07-13 17:50:29.995788397 +0000 UTC m=+169.398588186" Jul 13 17:50:31.799638 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:31.799520 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:50:31.912506 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:31.912469 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:50:31.973910 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:31.973878 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:50:32.508073 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:32.508043 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:50:32.563092 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:32.563058 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:50:33.323713 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:33.323675 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:50:42.428382 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:42.428327 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:50:42.512528 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:42.512489 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:50:42.566208 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:50:42.566174 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:00.368219 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:00.368155 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:06.255269 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:06.255209 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:14.416276 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:14.416230 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:28.323269 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:28.323225 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:51:28.339729 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:28.339701 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:51:29.201198 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:29.201168 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 17:51:37.198901 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:37.198864 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:37.300601 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:37.300562 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:45.903797 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:45.903756 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:45.961240 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:45.961207 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:46.046241 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:46.046198 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:46.105978 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:46.105917 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:46.640535 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:46.640497 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:46.692062 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:46.692031 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:49.173781 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:49.173744 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:49.273211 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:49.273175 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:52.444092 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:52.444057 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:52.546474 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:52.546445 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:52.610264 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:52.610236 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:56.686357 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:56.686310 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:56.789204 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:56.789168 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:59.107342 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:59.107310 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:51:59.161131 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:51:59.161100 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:52:34.679185 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:52:34.679128 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:52:34.740715 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:52:34.740662 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:52:41.031498 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:52:41.031467 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5x6m_82a64921-fe7c-4b5a-baad-67821a776384/ovn-acl-logging/0.log" Jul 13 17:52:41.038733 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:52:41.038701 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5x6m_82a64921-fe7c-4b5a-baad-67821a776384/ovn-acl-logging/0.log" Jul 13 17:52:41.039987 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:52:41.039280 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 17:53:10.829686 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:10.829646 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:53:12.609254 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:12.609215 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:53:13.370207 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:13.370177 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-svz7l_b018ff34-b64c-4dfa-acd6-af00b32f4b67/global-pull-secret-syncer/0.log" Jul 13 17:53:13.418925 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:13.418890 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" Jul 13 17:53:13.511779 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:13.511747 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-21.ec2.internal_16fb4b15b5b9f054086d5c3e130fb480/haproxy/0.log" Jul 13 17:53:17.059571 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.059487 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a713f17-bf18-4a6d-b088-c792adc3c143/alertmanager/0.log" Jul 13 17:53:17.104799 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.104767 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a713f17-bf18-4a6d-b088-c792adc3c143/config-reloader/0.log" Jul 13 17:53:17.148262 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.148234 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a713f17-bf18-4a6d-b088-c792adc3c143/kube-rbac-proxy-web/0.log" Jul 13 17:53:17.177853 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.177826 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a713f17-bf18-4a6d-b088-c792adc3c143/kube-rbac-proxy/0.log" Jul 13 17:53:17.214228 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.214190 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a713f17-bf18-4a6d-b088-c792adc3c143/kube-rbac-proxy-metric/0.log" Jul 13 17:53:17.241324 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.241300 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a713f17-bf18-4a6d-b088-c792adc3c143/prom-label-proxy/0.log" Jul 13 17:53:17.268357 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.268334 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a713f17-bf18-4a6d-b088-c792adc3c143/init-config-reloader/0.log" Jul 13 17:53:17.411691 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.411621 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-68cc8bfbc6-45h79_ade380b7-ae9e-4b55-843e-a6c7ff0ea9ab/metrics-server/0.log" Jul 13 17:53:17.564875 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.564846 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nbmlv_80bc51b3-1c87-451a-8165-b5d425ca3b78/node-exporter/0.log" Jul 13 17:53:17.589666 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.589643 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nbmlv_80bc51b3-1c87-451a-8165-b5d425ca3b78/kube-rbac-proxy/0.log" Jul 13 17:53:17.614567 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.614539 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nbmlv_80bc51b3-1c87-451a-8165-b5d425ca3b78/init-textfile/0.log" Jul 13 17:53:17.789856 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.789826 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0/prometheus/0.log" Jul 13 17:53:17.814866 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.814832 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0/config-reloader/0.log" Jul 13 17:53:17.863639 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.863612 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0/thanos-sidecar/0.log" Jul 13 17:53:17.896200 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.896172 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0/kube-rbac-proxy-web/0.log" Jul 13 17:53:17.924168 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.924139 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0/kube-rbac-proxy/0.log" Jul 13 17:53:17.963916 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.963894 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0/kube-rbac-proxy-thanos/0.log" Jul 13 17:53:17.997564 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:17.997533 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bc4a4af-ffb3-4d7f-85d9-a9bf9c253df0/init-config-reloader/0.log" Jul 13 17:53:18.261856 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:18.261784 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f57dcb85-hg8wn_ec399170-8051-4aea-9050-7935b2f50bbe/thanos-query/0.log" Jul 13 17:53:18.308270 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:18.308242 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f57dcb85-hg8wn_ec399170-8051-4aea-9050-7935b2f50bbe/kube-rbac-proxy-web/0.log" Jul 13 17:53:18.357272 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:18.357246 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f57dcb85-hg8wn_ec399170-8051-4aea-9050-7935b2f50bbe/kube-rbac-proxy/0.log" Jul 13 17:53:18.390070 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:18.390031 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f57dcb85-hg8wn_ec399170-8051-4aea-9050-7935b2f50bbe/prom-label-proxy/0.log" Jul 13 17:53:18.420231 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:18.420194 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f57dcb85-hg8wn_ec399170-8051-4aea-9050-7935b2f50bbe/kube-rbac-proxy-rules/0.log" Jul 13 17:53:18.442458 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:18.442434 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f57dcb85-hg8wn_ec399170-8051-4aea-9050-7935b2f50bbe/kube-rbac-proxy-metrics/0.log" Jul 13 17:53:20.494039 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.494007 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5"] Jul 13 17:53:20.497417 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.497400 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:20.500377 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.500355 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gz8c5\"/\"kube-root-ca.crt\"" Jul 13 17:53:20.500640 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.500620 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gz8c5\"/\"openshift-service-ca.crt\"" Jul 13 17:53:20.501641 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.501620 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gz8c5\"/\"default-dockercfg-g4g4v\"" Jul 13 17:53:20.507487 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.507463 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5"] Jul 13 17:53:20.574463 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.574421 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/857a38b0-6cfa-48e5-b1f8-4e0219b2713c-podres\") pod \"perf-node-gather-daemonset-4s9l5\" (UID: \"857a38b0-6cfa-48e5-b1f8-4e0219b2713c\") " pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:20.574649 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.574460 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/857a38b0-6cfa-48e5-b1f8-4e0219b2713c-sys\") pod \"perf-node-gather-daemonset-4s9l5\" (UID: \"857a38b0-6cfa-48e5-b1f8-4e0219b2713c\") " pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:20.574649 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.574570 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/857a38b0-6cfa-48e5-b1f8-4e0219b2713c-proc\") pod \"perf-node-gather-daemonset-4s9l5\" (UID: \"857a38b0-6cfa-48e5-b1f8-4e0219b2713c\") " pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:20.574649 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.574603 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbxjq\" (UniqueName: \"kubernetes.io/projected/857a38b0-6cfa-48e5-b1f8-4e0219b2713c-kube-api-access-gbxjq\") pod \"perf-node-gather-daemonset-4s9l5\" (UID: \"857a38b0-6cfa-48e5-b1f8-4e0219b2713c\") " pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:20.574649 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.574628 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/857a38b0-6cfa-48e5-b1f8-4e0219b2713c-lib-modules\") pod \"perf-node-gather-daemonset-4s9l5\" (UID: \"857a38b0-6cfa-48e5-b1f8-4e0219b2713c\") " pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:20.675397 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.675362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/857a38b0-6cfa-48e5-b1f8-4e0219b2713c-sys\") pod \"perf-node-gather-daemonset-4s9l5\" (UID: \"857a38b0-6cfa-48e5-b1f8-4e0219b2713c\") " pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:20.675583 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.675425 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/857a38b0-6cfa-48e5-b1f8-4e0219b2713c-proc\") pod \"perf-node-gather-daemonset-4s9l5\" (UID: \"857a38b0-6cfa-48e5-b1f8-4e0219b2713c\") " pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:20.675583 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.675444 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbxjq\" (UniqueName: \"kubernetes.io/projected/857a38b0-6cfa-48e5-b1f8-4e0219b2713c-kube-api-access-gbxjq\") pod \"perf-node-gather-daemonset-4s9l5\" (UID: \"857a38b0-6cfa-48e5-b1f8-4e0219b2713c\") " pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:20.675583 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.675467 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/857a38b0-6cfa-48e5-b1f8-4e0219b2713c-lib-modules\") pod \"perf-node-gather-daemonset-4s9l5\" (UID: \"857a38b0-6cfa-48e5-b1f8-4e0219b2713c\") " pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:20.675583 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.675495 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/857a38b0-6cfa-48e5-b1f8-4e0219b2713c-sys\") pod \"perf-node-gather-daemonset-4s9l5\" (UID: \"857a38b0-6cfa-48e5-b1f8-4e0219b2713c\") " pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:20.675583 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.675495 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/857a38b0-6cfa-48e5-b1f8-4e0219b2713c-proc\") pod \"perf-node-gather-daemonset-4s9l5\" (UID: \"857a38b0-6cfa-48e5-b1f8-4e0219b2713c\") " pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:20.675583 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.675501 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/857a38b0-6cfa-48e5-b1f8-4e0219b2713c-podres\") pod \"perf-node-gather-daemonset-4s9l5\" (UID: \"857a38b0-6cfa-48e5-b1f8-4e0219b2713c\") " pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:20.675772 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.675589 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/857a38b0-6cfa-48e5-b1f8-4e0219b2713c-podres\") pod \"perf-node-gather-daemonset-4s9l5\" (UID: \"857a38b0-6cfa-48e5-b1f8-4e0219b2713c\") " pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:20.675772 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.675624 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/857a38b0-6cfa-48e5-b1f8-4e0219b2713c-lib-modules\") pod \"perf-node-gather-daemonset-4s9l5\" (UID: \"857a38b0-6cfa-48e5-b1f8-4e0219b2713c\") " pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:20.685313 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.685287 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbxjq\" (UniqueName: \"kubernetes.io/projected/857a38b0-6cfa-48e5-b1f8-4e0219b2713c-kube-api-access-gbxjq\") pod \"perf-node-gather-daemonset-4s9l5\" (UID: \"857a38b0-6cfa-48e5-b1f8-4e0219b2713c\") " pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:20.807337 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.807300 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:20.959289 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:20.959259 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5"] Jul 13 17:53:20.961023 ip-10-0-138-21 kubenswrapper[2564]: W0713 17:53:20.960991 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod857a38b0_6cfa_48e5_b1f8_4e0219b2713c.slice/crio-0bd2e65adadee24b67837ca371593e7682e30f8d7b642c042974bc4fef8c99aa WatchSource:0}: Error finding container 0bd2e65adadee24b67837ca371593e7682e30f8d7b642c042974bc4fef8c99aa: Status 404 returned error can't find the container with id 0bd2e65adadee24b67837ca371593e7682e30f8d7b642c042974bc4fef8c99aa Jul 13 17:53:21.606364 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:21.606322 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" event={"ID":"857a38b0-6cfa-48e5-b1f8-4e0219b2713c","Type":"ContainerStarted","Data":"c4f1174148f69872fedb73963098df58acbdc2a6506a2a6a94cf0dfd92463273"} Jul 13 17:53:21.606713 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:21.606388 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" event={"ID":"857a38b0-6cfa-48e5-b1f8-4e0219b2713c","Type":"ContainerStarted","Data":"0bd2e65adadee24b67837ca371593e7682e30f8d7b642c042974bc4fef8c99aa"} Jul 13 17:53:21.606713 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:21.606438 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:21.632143 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:21.632116 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7fr9t_b1fc718c-9753-471c-963a-2ab6e27a75de/dns/0.log" Jul 13 17:53:21.653612 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:21.653587 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7fr9t_b1fc718c-9753-471c-963a-2ab6e27a75de/kube-rbac-proxy/0.log" Jul 13 17:53:21.803001 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:21.802949 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xvcqn_f31d603c-f23f-48fe-8f98-6b10c50684e9/dns-node-resolver/0.log" Jul 13 17:53:22.218287 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:22.218254 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vqppg_3c882599-36c2-4faf-bde2-90319ddc3b8b/node-ca/0.log" Jul 13 17:53:23.156986 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:23.156931 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-scpjr_6fd8f0fe-1073-4482-8848-ef76e7d2257f/serve-healthcheck-canary/0.log" Jul 13 17:53:23.500168 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:23.500093 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bfbs4_8209d6b1-4ed7-4dda-a050-9e3122139abf/kube-rbac-proxy/0.log" Jul 13 17:53:23.517788 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:23.517762 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bfbs4_8209d6b1-4ed7-4dda-a050-9e3122139abf/exporter/0.log" Jul 13 17:53:23.535898 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:23.535866 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bfbs4_8209d6b1-4ed7-4dda-a050-9e3122139abf/extractor/0.log" Jul 13 17:53:27.234416 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:27.234361 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-8gbm9_44987d76-d577-4f20-9fd3-87e568a82b67/migrator/0.log" Jul 13 17:53:27.251652 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:27.251623 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-8gbm9_44987d76-d577-4f20-9fd3-87e568a82b67/graceful-termination/0.log" Jul 13 17:53:27.620768 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:27.620741 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" Jul 13 17:53:27.638508 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:27.638459 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gz8c5/perf-node-gather-daemonset-4s9l5" podStartSLOduration=7.638440666 podStartE2EDuration="7.638440666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:53:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:53:21.629125949 +0000 UTC m=+341.031925738" watchObservedRunningTime="2026-07-13 17:53:27.638440666 +0000 UTC m=+347.041240456" Jul 13 17:53:28.236537 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:28.236509 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-245zw_19c02c32-bd49-4583-9a27-d02d09520252/kube-multus/0.log" Jul 13 17:53:28.414237 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:28.414211 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv44q_1ee5e9ae-8b98-4cf8-965a-ed649be3add6/kube-multus-additional-cni-plugins/0.log" Jul 13 17:53:28.436433 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:28.436404 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv44q_1ee5e9ae-8b98-4cf8-965a-ed649be3add6/egress-router-binary-copy/0.log" Jul 13 17:53:28.454303 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:28.454277 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv44q_1ee5e9ae-8b98-4cf8-965a-ed649be3add6/cni-plugins/0.log" Jul 13 17:53:28.470714 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:28.470690 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv44q_1ee5e9ae-8b98-4cf8-965a-ed649be3add6/bond-cni-plugin/0.log" Jul 13 17:53:28.487366 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:28.487292 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv44q_1ee5e9ae-8b98-4cf8-965a-ed649be3add6/routeoverride-cni/0.log" Jul 13 17:53:28.503835 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:28.503809 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv44q_1ee5e9ae-8b98-4cf8-965a-ed649be3add6/whereabouts-cni-bincopy/0.log" Jul 13 17:53:28.519562 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:28.519539 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv44q_1ee5e9ae-8b98-4cf8-965a-ed649be3add6/whereabouts-cni/0.log" Jul 13 17:53:28.785700 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:28.785675 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zvwps_a938d7f2-3fd3-4def-8106-4e7ae5529979/network-metrics-daemon/0.log" Jul 13 17:53:28.803666 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:28.803637 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zvwps_a938d7f2-3fd3-4def-8106-4e7ae5529979/kube-rbac-proxy/0.log" Jul 13 17:53:29.609301 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:29.609272 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5x6m_82a64921-fe7c-4b5a-baad-67821a776384/ovn-controller/0.log" Jul 13 17:53:29.628152 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:29.628129 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5x6m_82a64921-fe7c-4b5a-baad-67821a776384/ovn-acl-logging/0.log" Jul 13 17:53:29.628152 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:29.628144 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5x6m_82a64921-fe7c-4b5a-baad-67821a776384/ovn-acl-logging/1.log" Jul 13 17:53:29.646697 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:29.646670 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5x6m_82a64921-fe7c-4b5a-baad-67821a776384/kube-rbac-proxy-node/0.log" Jul 13 17:53:29.669297 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:29.669263 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5x6m_82a64921-fe7c-4b5a-baad-67821a776384/kube-rbac-proxy-ovn-metrics/0.log" Jul 13 17:53:29.688845 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:29.688816 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5x6m_82a64921-fe7c-4b5a-baad-67821a776384/northd/0.log" Jul 13 17:53:29.707708 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:29.707675 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5x6m_82a64921-fe7c-4b5a-baad-67821a776384/nbdb/0.log" Jul 13 17:53:29.728538 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:29.728511 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5x6m_82a64921-fe7c-4b5a-baad-67821a776384/sbdb/0.log" Jul 13 17:53:29.764627 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:29.764580 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5x6m_82a64921-fe7c-4b5a-baad-67821a776384/ovnkube-controller/0.log" Jul 13 17:53:31.171115 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:31.171092 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-z6nrr_2a16bf86-0f45-482d-8b4f-58a84da77eb0/network-check-target-container/0.log" Jul 13 17:53:32.043413 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:32.043382 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-2sk92_0e58a202-5020-4eda-b3d4-e63b4d1bc89c/iptables-alerter/0.log" Jul 13 17:53:32.702894 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:32.702869 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-zl6ls_3ec87333-cc94-405e-ae5e-03501dee25f4/tuned/0.log" Jul 13 17:53:33.731173 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:33.731132 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f82xp_f9bbd505-ffac-4022-981c-f71bfb01ede3/konnectivity-agent/0.log" limit=1024 Jul 13 17:53:35.537665 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:35.537626 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-79f68b9f4f-vp7kh_27f47f98-b8eb-4dad-9509-ea6ee87e3b28/service-ca-controller/0.log" Jul 13 17:53:35.856368 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:35.856298 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-ft8sl_c723457c-5381-4f13-84fa-f01a9086e2b8/csi-driver/0.log" Jul 13 17:53:35.874042 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:35.874020 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-ft8sl_c723457c-5381-4f13-84fa-f01a9086e2b8/csi-node-driver-registrar/0.log" Jul 13 17:53:35.892642 ip-10-0-138-21 kubenswrapper[2564]: I0713 17:53:35.892614 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-ft8sl_c723457c-5381-4f13-84fa-f01a9086e2b8/csi-liveness-probe/0.log"